Background
About 90% of all drug prescriptions for outpatients are issued in general practice [
1]. Patients in general practice are more likely to have less severe disease, and more undifferentiated symptoms than selected patients in secondary or tertiary health care, however, multimorbidity is common [
2]. If a study population in a drug trial differs significantly from the population where the drug is most likely to be prescribed, the external validity of the trial may be impaired [
3]. To avoid this uncertainty, many have argued that more clinical drug trials should be conducted in primary care settings to ensure that the benefits are proportionate to the risks and costs of the treatment for patients in general practice [
4,
5]. Clinical drug trials may serve different purposes, from research of effectiveness, to marketing [
6]. Trials with the main purpose of introducing new drugs to prescribers are often referred to as ‘seeding trials’. Various criteria for seeding trials have been proposed (Table
1) [
7‐
9], and it is characteristic that the trials are designed to make many clinicians familiar with a new drug. Being frequent prescribers, general practitioners (GPs) are probably of particular interest for designers of seeding trials; this is also because GPs are relatively independent in their decision-making processes.
Table 1
Case study: the ‘On-demand Nexium Evaluation’ (ONE) trial
a
Tests a new drug recently or about to be licensed | Yes: application year 2000, study completed by the end of 2001; esomeprazole licensed in 2001 |
Many well established competing products | Yes: omeprazole from 1989, lansoprazole and pantoprazole from 1995 |
Many patients included | Yes: 2,500 patients (the trial with most Norwegian patients to be included). In addition, similar studies have been conducted in other countries (see main text). |
Frequent prescribers in the role of clinical investigators | Yes: 402 general practitioners (GPs; the study involving most Norwegian GP investigators) |
Often redundant as they are not designed for answering a scientific problem | Probably yes |
Unreasonably high payments for the investigators | No: €750 which is below the 25th percentile for all trials |
Results are often not published | No: there were three publications |
Conducted by drug company marketing departments | Unknown |
In the UK between 1984 and 1989, general practice trials initiated by pharmaceutical companies were judged to have a low output of clinically relevant results [
10]. The concerns addressed in that audit were mainly payments to GPs, information and safety issues, shortfall of investigators and patients, leading to inconclusive results, and low publication rates [
10]. Among general practice studies published 1991 to 1996 in the
BMJ, the
British Journal of General Practice, and
Family Practice, only 6% were randomized controlled trials, which was pointed out as a major challenge for the general practice research community [
11]. Some Norwegian data regarding clinical drug trials have previously been reported, based on research applications submitted to the Research Ethical Committees (REC) [
12‐
14] and the Norwegian Medicines Agency (NoMA) [
15,
16]. Between 68% and 85% of the trials were initiated by pharmaceutical industry [
13‐
15], however, neither of these reports highlighted studies in general practice.
From the 1970s, a subcommittee of the Norwegian College of General Practitioners had a voluntary agreement with the pharmaceutical industry to assess protocols for studies to be performed in general practice [
17,
18]. If the committee judged the trial to be clinically relevant and of sound scientific quality, GPs were recommended to participate in the trial. However, by the turn of the millennium, the committee voiced critical comments regarding some trials judged to be marketing (due to features of seeding trials) rather than research [
17]. Since then, this voluntary quality and relevance check has been largely bypassed by the industry [
19], and information regarding industry initiated research in Norwegian general practice has thus become an almost hidden reality except for the investigators themselves. This prompted the Norwegian College of General Practitioners in 2008 to fund research to gain systematic knowledge of the drug research carried out by GPs. This included establishing an overview of all trials conducted, exploring whether GPs were subject for marketing trials, and assessing the relevance of the research questions addressed, as well as the studies’ validity and publication output. The College requested this knowledge due to possible implications for their policy for future professional development within the discipline of general practice.
The aim of the present study was to establish a descriptive basis regarding clinical drug trials conducted in general practice by research areas and trial characteristics. As most clinical drug trials are multinational, this study also should concern research in general practice outside of Norway.
Methods
In Norway, the only complete national archive for drug trials is held by NoMA. Based on a hand search of the NoMA archive for the 10-year period 1998 to 2007, we describe all clinical trials planned to be carried out in general practice by their funding, clinical setting, drugs, diagnoses, patients, clinical investigators and economic compensations for the investigators. More detail will be given regarding one of the trials in year 2000, which the Norwegian College of GPs discouraged GPs to join [
17], to give the reader a better sense of what we consider a seeding trial. Ethical approval for our study was not required.
Dataset
In Norway, all clinical pharmaceutical trials regardless of setting need approval from NoMA, the national, regulatory authority for new and existing medicines. Clinical trials are regulated by international and national laws, in which there were amendments between 1998 and 2007, and from 2004 the European Directive 2001/20/EC has been implemented in the Norwegian regulation [
16]. By hand searching NoMA’s total paper archive, protocol by protocol, we were able to identify application forms, protocols and other correspondence received by NoMA regarding applications for clinical drug trials between 1998 and 2007, the 10-year period before conversion to electronic registration. The computed total number of trial applications during this decade was 2,054 [
16,
20] (personal communication from I. Aaløkken, NoMA). The main hand search was performed in May to August 2008 by KBJ. Supplementary data collection and verification was performed by AMB between November to December 2011 for a total of 89 studies. No formal inter-rater reliability calculations were performed, but no significant errors or discrepancies were disclosed. A random check of non-included studies in the archive did not reveal any additional general practice trials. Applications for trials planned to take place solely or partly in general practice were included. General practice trials were defined as trials where the address and/or titles indicated that at least one of the Norwegian clinical investigators worked in general practice.
Variables: trial characteristics
For included studies, we recorded study title, medication tested in terms of its Anatomical Therapeutic Chemical (ATC) classification code [
21], funders, whether the study was planned exclusively to be conducted in general practice or also in specialist care settings, whether it was a national or international study, and trial phase based on explicit information in the application ((I) study of toxicity and side effects; (II) study of dose-response; (III) comparison with established treatment or placebo; or (IV) post-marketing study, gaining broader experience) [
6]. We defined a study as industry initiated when a pharmaceutical company funded the study, wrote the study protocol or conducted the study, either the company itself or via a contract research organization. If the study drugs were provided free of charge, but the trial was otherwise designed and conducted independently under the responsibility of a GP researcher, it was defined as researcher initiated. There were no trials with unclear funding. We recorded the number of patients planned to be included internationally, and at Norwegian trial sites, the number of clinical investigators involved, trial duration, and if available, economic compensation for physicians involved. We also identified clinical investigators who were GP academics, that is, having affiliations to Norwegian general practice university departments. The main diagnostic criteria for inclusion in a study were based on the study title, and when necessary supplemented with information from the protocol and categorized according to the
International Classification of Primary Care, second edition (ICPC-2) [
22]. One of the authors (AMB) performed the categorization, and when in doubt, consensus was reached through discussions between AK, JS and AMB.
Data analysis
Data were compiled in a spreadsheet. To compare planned number of patients to be enrolled in trials partly or entirely to be undertaken in general practice, we used the independent samples Mann-Whitney U test, and otherwise we used descriptive statistics. Due to data skewness, median values are presented rather than means. We roughly estimated investigator incomes by multiplying median payment and median number of patients planned recruited divided by median number of investigators. Statistical analyses were performed using SPSS statistics (PASW Statistics 18; SPSS Inc., Chicago, IL, USA).
Case study
One outlying case is described in greater detail. For this trial, additional information is given on patients, interventions, comparison and outcome based on the study protocol. A systematic literature search was performed to identify publications arising from the trial (date of literature search, 17 September 2012). The trial was assessed according to the proposed criteria for seeding trials outlined in Table
1[
7‐
9].
Discussion
The main findings in this study were that only about one-tenth of all clinical drug trials in Norway involved GPs as clinical investigators recruiting patients from their practices, and only 3.6% of these were non-industry trials.
We found that the proportion of researcher-initiated clinical drug trials in general practice in Norway was minute (3.6%) compared to clinical drug trials from other fields of medicine where 15% to 32% are non-commercial studies [
13‐
15]. Conducting clinical trials in general practice poses some typical challenges, like difficulties with study logistics and patient recruitment in a large number of small trial sites [
4]. The lack of researcher-initiated trials has also been pointed out in the European Research Agenda for General Practice [
5]. Irrespective of their commercial interests, this research agenda underlines that drugs mainly targeting primary care should be appropriately tested in primary care settings. Furthermore, that a stable funding and formation of research networks may facilitate non-commercial randomized controlled trials in general practice [
5]. Although many have pointed to the need for clinical drug trials conducted independently of the industry, there was nonetheless a decline in the number of non-commercial randomized controlled trials in the UK between 1980 and 2002 [
27]. Several systematic reviews have pointed out that drug trials financed by pharmaceutical industry tend to publish results more in favor of the manufacturer’s product than non-commercial trials, and that negative studies in this respect commonly remain unpublished [
28‐
32]. This publication bias combined with the lack of non-industry trials in general practice might therefore contribute to an evidence-biased knowledge base.
Over the last few years, there has been a decline in the number of clinical trials in several European countries [
33,
34]. In Norway, the largest reduction has been in phase III studies [
16]. For general practice studies we were not able to confirm this trend, even if the majority of trials in our material were phase III or IV. The trials where explicit information regarding trial phase was missing, were most likely also phase III or IV. The five companies funding most general practice trials were among the seven most profitable companies, thus largely reflecting their market positions [
23].
A study from 2000 found that 84% of GPs in a part of England had been involved in research, 48% mainly in clinical trials [
35]. Our figures indicate that Norwegian GPs’ participation rate in clinical trials is less than half of that in the UK; the 831 GPs involved correspond to about 20% of all Norwegian GPs in 2002 [
1]. Surprisingly few GPs with university affiliations had participated in clinical drug trials, although many of them work part-time as GPs and are particularly interested in clinical research. Explanations for this finding may be that they judged the clinical relevance of the industry funded trials to be low, feared conflicts of interest, or had general negative attitudes towards collaboration with pharmaceutical companies [
36]. Most GPs involved in clinical trials only participated once or just a few times, and did therefore not gain large incomes for participating. However, a number of GPs were involved in quite a few trials, giving them a substantial yearly income from trial participation. A few trials also gave outstandingly high payment for the doctors involved. Most GPs in Norway are self-employed with a major part of their income from patient payment and per capita reimbursement. It is therefore reasonable that extra workload due to participation in clinical trials is compensated. But how much is a reasonable level of compensation? Payment to clinicians for participation in clinical trials varies a lot [
36,
37]. Andersen
et al. report payments of US $800 per patient enrolled for a Danish industry initiated trial [
37], which is approximately one-third of the median payment in our material. Raftery
et al. point to the striking lack of transparency in guidelines for payments for involvement in research, where GPs are among the few individual clinicians where direct personal payment still is common [
36]. Concerns have been voiced that high payments may create conflicts of interest and possibly lead to unethical recruitment processes [
36]. This demands rigorous ethical standards from both the general practice community and the pharmaceutical industry.
We identified antidiabetic drugs and type II diabetes to be studied most frequently. Thomas
et al. found few published articles on diabetes in UK primary care journals in the 1990s [
11]. The general use of antidiabetics in Norway increased by 27% (in defined daily doses (DDDs)) from 2004 to 2008 [
38]. This may both reflect increasing diabetes prevalence but also the introduction of new drugs. Andersen
et al. found that physicians conducting a clinical trial, significantly increased the sponsor’s share of prescribed drugs for the disease compared to GPs not involved in the trials [
37], and this might be important for expanding the market. The many post-marketing studies of new and expensive insulin analogues with large market potentials have recently been criticized for limited scientific value [
9]. The three largest drug groups investigated in our study were among the four most consumed drugs in Norway (in terms of DDDs) [
38]. These therapeutic areas were also among the six most frequently researched topics in general practice internationally between 2003 and 2008 [
5]. In Norway in years 2000 and 2004 [
14], and in the UK 1980 to 2002 [
27], most clinical trials were in the field of cancer and antineoplastic and immunomodulating drugs. We only identified two trials in this field. This was as expected, as GPs rarely initiate antineoplastic drug prescriptions. Only one trial studied the effects of discontinuation of (unnecessary) medication use, although this is an important topic both for quality of care and general practice research [
5].
Strengths and limitations of the study
The NoMA archive is a mandatory, complete national archive of all clinical drug trials in Norway, and it is a strength that we managed to include all trial protocols, not restricted to a specific region or to trials that had been reported in scientific publications. The large proportion of multinational trials identified also increases the external validity of our findings, which therefore may be relevant for general practice in other countries. As the identification of trials was performed by hand searching, random errors may have occurred during this process and recording of results. The main hand search was performed by only one of the authors, but supplementary searches in the archive for completing information by another author did not reveal significant errors. The total number of trials (2,054 trials) for the 10-year period was summed up from numbers provided by NoMA, and the exact total number of investigated paper files was not recorded, although the whole archive was searched shelf by shelf. Some uncertainty regarding missing files in the archive is therefore possible, however, we believe the number of missing files to be negligible due to strict control and restricted access to the state run archive. We have not addressed the number of clinical trials that were never conducted, either from lack of approval from REC or NoMA, or for other reasons, but this will be a subject of future research. The patient numbers reported involve all trial sites in Norway, and we do not know the exact number of general practice patients. Concerning trial phase, the proportion of missing data was quite large. The same applies to investigator payments, which were under-reported to NoMA, especially during the first years in the time period studied.
Case study: a seeding trial?
The intentions for conducting a seeding trial are in general hidden and they may therefore be difficult to identify. Seeding trials have usually been disclosed based on documents from litigation processes [
39,
40]. Without access to internal communication within the drug company, the judgment of whether a trial is designed for marketing has to be based on several aspects. The esomeprazole trial described has many features being typical for a seeding trial, with several of the key characteristics described in Table
1[
7‐
9].
Esomeprazole was launched in 2001 in a crowded drug group. It is the most expensive of the proton pump inhibitors, and had become the tenth most-sold medicine in Norway in 2008 calculated in terms of pharmacy retail prices [
38]. The esomeprazole trial described was large, and the sample size calculations were based on a higher power than conventionally used [
41]. A higher power demands larger sample sizes and more patients to be enrolled into the study. No ethical considerations regarding these issues were discussed in the peer-reviewed publications arising from the trial [
24‐
26]. The open design and the inclusion only of patients responding to high doses of esomeprazole in the intention-to-treat analyses increased the risk of bias in favor of esomeprazole. One may question the scientific need for recruiting around 400 GPs in the trial, each GP only enrolling a handful of patients with gastroesophageal reflux, a relatively common health complaint. The large number of participating doctors was not explained or justified in the protocol or in publications arising from the trial [
24‐
26]. Nevertheless, the trial was approved by both the regional ethics committee and NoMA without any major remarks. The general practice research committee criticized this protocol on several issues, some of which are listed above [
17,
19,
42]. The trial was presented in Norway as a separate trial, but quite similar studies with the same protocol acronym (ONE) have been reported from Denmark (without ranitidine comparison) [
43] and Switzerland [
44] in total involving almost 3,500 patients.
Conclusions
Only one-tenth of all clinical drug trials in Norway involved patients recruited from general practice, and just one in four of these trials were solely general practice trials. Almost all trials were industry initiated without input from academic general practice. This shows that it is a challenge for general practice to increase the number of clinical trials in general and researcher initiated clinical drug trials in particular. Antidiabetic drugs were most commonly studied. There was a large variation in the number of patients, participating doctors, and economic compensation for trial investigators, with some investigators receiving substantial payments. We describe a study with several characteristics of a seeding trial, where none of the official approving bodies for clinical trials had any major remarks. It raises the important ethical considerations with regard to exposing patients to unnecessary risks in either an inordinately large or a small, underpowered trial.
In this descriptive study, we have addressed neither the relevance of the research questions for general practice nor the methodological quality or publication output of the trials beyond the case study. These are important issues that we intend to explore in forthcoming research.
Competing interests
The authors declare that they have no competing interests. The authors alone are responsible for the content and writing of the paper.
Authors’ contributions
AMB completed the data collection, analyzed and interpreted the data and drafted the manuscript. KBJ participated in the design of the study, acquired most of the data and critically revised the manuscript. AK analyzed and interpreted the data, and critically revised the manuscript. JS conceived and designed the study, participated in the analysis and interpretation, and critically revised the manuscript. All authors read and approved the final manuscript.