INTRODUCTION
Chronic non-cancer pain (CNCP) is common among primary care patients. There has been a rise in prescription opioid analgesic use for the treatment of CNCP
1,
2, and a rise in opioid analgesic misuse, with a prevalence of 9% to 41% in patients treated with opioid analgesics for CNCP
3‐
6. Patients with HIV/AIDS have a high prevalence of chronic pain (prevalence 40%-60%), mental health, and substance use disorders
11‐
14. On the one hand, mental health and substance use disorders are associated with opioid analgesic misuse
7‐
9, and on the other hand, they are also risk factors for under treatment of pain in HIV-infected patients
10,
11. Clinicians must rely on existing tools and their judgment of patients’ likelihood of misuse before continuing to prescribe opioid analgesics. Studies have shown that clinicians judge non-white patients to have a higher risk for prescription opioid misuse when compared to white patients
15,
16. However, existing data do not support these beliefs
7,
8.
There are several risk stratification tools that rely on patients’ self-reports of misuse
17‐
22; none have adequate sensitivity and specificity to guide treatment decisions
23. Clinicians can use urine toxicology screens, pill and patch counts to measure adherence and monitor for use of non-prescribed opioid analgesics or illicit substances
24. A recent systematic review found insufficient evidence for routine urine toxicology testing because of the difficulty interpreting negative tests, which could indicate diversion, inadequate treatment of pain, or inadequate test sensitivity
24‐
26. Another element of risk assessment is clinicians’ impressions. Few studies have examined clinicians’ impressions of misuse
27, and none have directly compared clinicians’ opinions of misuse to patients’ self-reports.
We conducted a patient–provider dyad study, co-enrolling members of a representative community-based cohort of indigent adults with HIV-infection and their primary care providers (PCPs) to determine the concordance and discordance of PCPs’ judgments about prescription opioid misuse and illicit substance use compared to patients’ self-reports. We hypothesized that PCPs’ estimates of misuse would have a low concordance with patients’ self-reports. We hypothesized that PCPs would overestimate risk in African American patients, while underestimating risk in white patients.
METHODS
Study Patients and Sampling
We enrolled patient participants (“patients”) into the dyad study from a two-year longitudinal study of pain, use and misuse of opioid analgesics in a community-based sample of indigent adults (Pain Study). We recruited members of the Pain Study from the pre-existing Research on Access to Care in the Homeless (REACH) study, a longitudinal study of HIV-infected adults in San Francisco who were systematically sampled from homeless shelters, free meal programs, and low-rent single-room occupancy hotels
28. We offered participation, regardless of pain status, to all active REACH members between September 2007 and June 2008 (n = 337); 296 (87.8%) completed enrollment and baseline activities.
One year into the Pain Study, we began enrolling primary care providers (PCPs) identified by Pain Study patients. We recruited the PCP that each study patient identified, if the patient gave informed consent and the identified PCP met our definition (physician, Nurse Practitioner (NP), or Physician Assistant (PA) providing longitudinal, comprehensive care).
All study protocols were reviewed and approved by the University of California, San Francisco (UCSF), Institutional Review Board; we obtained a Certificate of Confidentiality from the National Institute on Drug Abuse. We told both patients and PCPs that the information they provided would be kept anonymous and not shared with the other party.
Study Procedures
We conducted data collection from the patients at the UCSF Clinical and Translational Research Institute’s Tenderloin Clinical Research Center (TCRC), a community-based university-research site. Trained research assistants administered the Pain Study and REACH study questionnaires every three months. At the baseline Pain Study interview, a trained interviewer administered the Diagnostic Interview Schedule—IV (DIS-IV) substance modules (cocaine, methamphetamine, and heroin)
29. At each REACH study quarterly visit, trained interviewers obtained information on current illicit substance use. At each Pain Study quarterly visit, patients answered questions about prescription opioid analgesic misuse using Audio Computer Assisted Self-Interview (ACASI) technology
30.
We recruited and collected data from PCPs by mail, using a modified version of Dillman’s Tailored Design Method
31. PCPs completed a short, provider-specific questionnaire and a separate patient-specific questionnaire for each of their dyad-study patients. PCPs were encouraged, but not required, to access their patients’ medical records while completing the patient-specific questionnaires.
We reimbursed patients $20.00 for the baseline Pain Study interview, $5.00 for each Pain Study quarterly interview, and $20.00 for each REACH study quarterly interview. PCPs received a $10.00 gift certificate for each completed questionnaire.
Variable Definitions
Patients
At the baseline Pain Study and REACH study visits, patients self-reported information on demographics (age and sex), race/ethnicity (white, African American, Hispanic, or mixed/other), residential stability, jail and prison stays, mean monthly income, insurance status (Medicaid/ Medicare, AIDS Drug Assistance Program (ADAP), or uninsured), and lifetime tobacco history (smoked at least 100 cigarettes in lifetime). We administered the Beck Depression Inventory – II (BDI) and classified depression as moderate to severe (BDI score >19) or none or mild (BDI score ≤19)
32,
33. We administered the Brief Pain Inventory (BPI)
34, and using patients’ self-reports of average intensity of pain in the past 7 days and cut-point analysis, we classified pain as mild (0-3), moderate (4-5), or severe (6-10)
35.
We created an inventory of opioid analgesic misuse behaviors that have been previously described in the literature
14,
36‐
38. We defined opioid analgesic misuse as getting high, altering the route, selling, stealing, forging prescriptions, trading street drugs for opioids, and exchanging opioids for sex in the past 90 days. We used patients’ ACASI self-reports of misuse from four quarterly interviews to create a dichotomous variable that measured past-year misuse. We created a variable that combined responses for getting high, altering the route or selling prescription opioids (“one or more misuse behaviors”) to mirror what we had asked PCPs.
We obtained self-reports of illicit substance use (cocaine, methamphetamine, and heroin) in the past 90 days from the REACH quarterly interviews, and created a dichotomous variable of any illicit substance use in the past year based on four quarterly interviews. We diagnosed lifetime substance abuse or dependence for cocaine, methamphetamine, and heroin using the DIS-IV instrument
29. We used the DIS-IV question, “Which one of these have you used more than five times when they were not prescribed for you, or for longer than prescribed, to feel more active or alert, or to feel good or high?” to define lifetime substance use of cocaine, methamphetamine, and heroin.
Primary Care Providers
In the provider-specific questionnaires, PCPs answered questions on demographics (age and sex), race/ethnicity (white, African American, Hispanic, or Asian/Pacific Islander), clinical training (physician, NP or PA), specialty for physicians (internists, family practice or other), subspecialty for internists (Infectious disease (ID) or HIV), and years in clinical training (4 to 9 years, 10 to 19 years, ≥20 years).
In the patient-specific questionnaire, PCPs reported whether they had prescribed that patient an opioid analgesic, and whether they had ordered urine or blood toxicology screens. Using a 5-point Likert scale, PCPs reported whether their study patient had misused opioid analgesics by getting high, altering the route, or selling these medications. We classified responses as affirmative (maybe, probably or definitely) versus negative (probably not or definitely not). We asked PCPs’ to estimate (yes versus no or don’t know) whether the dyad-study patients they were responding for had used individual illicit substances (cocaine, methamphetamine, and heroin). We created a variable that measured PCPs’ composite affirmative responses of any illicit substance use in the past year for each patient under their care.
Statistical Analysis
We compared dyad-study patients’ self-reports of opioid analgesic misuse or illicit substance use with their corresponding PCPs’ assessments. We matched the date that the PCP completed the patient-specific questionnaire to the closest-occurring quarterly interview completed by the patient, and included three prior quarterly interviews to create a one-year assessment time period.
We restricted our analysis to patients who were prescribed an opioid analgesic in the past year based on PCPs’ reports. We calculated the sensitivity and specificity of PCPs’ opinions of opioid analgesic misuse and illicit substance use compared to patients’ self-reports, and used the Kappa statistic to measure concordance between PCPs’ opinions and patients’ self-reports.
We used logistic regression to examine patient factors that were associated with PCPs’ thinking that their patients had misused prescription opioid analgesics in the past year. We used patients’ age, sex, race (African American versus non-African American) and history of illicit substance use in the past year as independent variables as these have been shown to predict opioid misuse or to be associated with PCPs’ perception of misuse in prior studies. We then determined if any of these factors were independent predictors of patients’ self-reports of past-year misuse. All analyses were conducted using Stata software, version 11.
DISCUSSION
We found that PCPs judgments of opioid analgesic misuse were discordant with patients’ ACASI self-reports. PCPs were more likely to overestimate misuse in younger and African American patients. PCPs determinations of misuse were more accurate among patients with histories of illicit substance use. To our knowledge, this is the first study that compares PCPs’ estimates of prescription opioid misuse with patients’ ACASI self-reports. Our study highlights the challenges of determining and monitoring opioid misuse.
We selected patients who were indigent and living in an urban poor neighborhood to reflect a group of patients thought to be at increased risk of misuse. Despite this, PCPs were more likely to think that African American patients had misused opioid analgesics, even though they were no more likely to report misuse. Patients’ race was shown to be associated with clinicians’ perceptions of patients’ likelihood of risk behaviors
16. White patients are more likely to be prescribed opioid analgesics for the treatment of chronic pain than non-whites;
15 though, no evidence points to a higher risk of misuse by non-whites
7,
8. Studies suggest that providers invoke racially based stereotypes when faced with clinical ambiguity or complex medical decisions
39. In the absence of adequate training or objective measures to determine misuse, PCPs may have unknowingly relied on racially based clinical stereotypes when making these assessments
16. PCPs’ lack of knowledge and training on determining opioid misuse may increase the probability of use of these stereotypes to determine patient behaviors.
PCPs were more likely to think that younger patients had a higher risk of misuse. Younger age was found to be a consistent predictor of opioid misuse among the general patient population
7,
8,
37. However, younger age was not associated with misuse in our study. Uniformly applying established predictors without contextualizing to the target patient population might result in erroneous conclusions.
PCPs’ identification of illicit substance use was better than that of prescription opioid analgesic misuse. Tools such as urine toxicology screens are easier to interpret for presence of illicit substances than for assessing prescription opioid misuse. Illicit substance use in the past year was associated with patients’ self-reports of opioid misuse. These findings are supported by prior studies that showed that illicit substance use was one of the most reliable predictors of future prescription opioid misuse in clinic-based samples
7,
9.
Given the difficulty in making these assessments, several risk stratification tools have been developed to help providers identify patients at risk for misuse, though none of these tools have been validated in high-risk patients seen in primary care clinics
17,
18,
21‐
23. In the absence of a single, gold-standard test for determining opioid analgesic misuse, PCPs need to be conscious of their preconceptions and substantiate their clinical judgments of misuse with all available tools. Studies that examine the predictive validity as well as applicability of these tools to primary care providers caring for high-risk patients are needed.
The high-risk patients in our study were representative of those who are disproportionately affected by chronic pain and co-occurring substance use disorders
4,
40 and are routinely treated in primary care practices that lack the resources of specialty pain clinics. Therefore, identifying better strategies to monitor opioid misuse and providing additional resources for patients with co-occurring substance use disorders is important given rising rates of opioid misuse and the serious consequences of overdose
41,
42.
We note several limitations. We relied on patients’ self report as the ‘gold standard’, which may have underestimated the prevalence of opioid analgesic misuse and illicit substance use. This may have lead to misclassification bias. We tried to minimize underreporting by using ACASI technology, which reduces barriers in reporting sensitive information
30,
43. While self-reports may have lead to underreporting, other methods such as urine toxicology screens are similarly imperfect. A recent systematic review concluded that there was inadequate evidence to support using urine toxicology tests to determine opioid misuse, and highlighted the difficulty of using ‘objective’ data for measuring misuse
24,
25. Despite our overall good response rate for PCPs, we did not have information on non-responders, thus introducing a potential for selection bias. Our patients were poor, HIV-infected, from one urban area, and had high rates of chronic pain and illicit substance use, limiting the generalizability of our findings. However, these findings may be applicable to other urban, poor, non-HIV infected patient populations with a high burden of chronic pain, depression, and substance use disorders
44‐
46.
Our study had several strengths. Patients were recruited systematically from high-risk communities, and from these, we selected those who were prescribed opioid analgesics. We minimized recall bias by obtaining self-reports in the past 90 days instead of the past year. Patients reported misuse using ACASI at a community-based research site separate from clinical settings. We recruited PCPs from diverse clinical settings including general and HIV specific community health clinics, private practices and university-affiliated medical practices.
We found that PCPs’ assessments of opioid misuse were discordant with patients’ self-reports and appeared to factor patients’ age and race incorrectly. As use and misuse of these medications continue to rise, PCPs will need more reliable means of determining misuse. Increasing awareness among PCPs about the harmful effects of racially based heuristic shortcuts on clinical assessments of misuse and providing education on contextualizing risk and incorporating individual patient experiences may improve the accuracy of estimates of misuse.