Background
Tuberculosis (TB) remains a global health problem, with an estimated 1.4 million deaths and 8.7 million new cases reported in 2011 [
1]. Pulmonary TB is the most common form of TB, with extrapulmonary TB (EPTB) accounting for ~15% of cases, but this estimate increases to ~50% in high HIV prevalence settings [
2]. Pleural TB, a common form of EPTB, remains a common problem for physicians practising in high, intermediate and low TB burden settings, particularly where there are large immigrant populations. The diagnosis of pleural TB is challenging due to the paucibacillary nature of biological samples, and the need for diagnostic confirmation using invasive, expensive, and time consuming procedures such as blind pleural biopsy, imaging-guided-pleural biopsy, and medical or surgical thoracoscopy [
3].
Proxy markers such as adenosine deaminase (ADA), an enzyme that catalyzes the conversion of adenosine and deoxyadenosine to inosine and deoxyinosine has been widely studied [
4]. ADA testing is relatively easy, inexpensive and rapid, with pooled sensitivity and specificity estimates of 92% and 90%, respectively, across different prevalence settings depending on the cut-point used [
4]. Interferon gamma (IFN-γ), an inflammatory cytokine secreted from macrophages and CD4 (+) T cells in response to
M. tuberculosis infection, and that tends to concentrate in the pleural space, has been shown to be an alternative biological marker for pleural TB diagnosis with pooled sensitivity and specificity estimates of 89% and 97%, respectively [
5]. In high TB/HIV burden settings the performance was shown to be even better: sensitivity 97% and specificity 100% [
6].
More recently the Xpert MTB/RIF assay, a fully automated quantitative real-time hemi-nested PCR, was introduced into high burden settings and is able to detect
M. tuberculosis within 2 hours and also provide information about rifampicin susceptibility [
7]. The assay has been validated using sputum samples and recently endorsed by the WHO as a rapid test for both smear-positive and smear-negative (paucibacillary) respiratory samples [
8,
9]. However, there are limited data about the Xpert MTB/RIF assay using pleural fluid [
10‐
17] and thus the usefulness of this assay in the context of pleural TB remains unclear. Limitations of previously published work include the relatively small number of patients with pleural TB (usually quoted as part of a larger series of patients with EPTB), a paucity of biopsy-proven or culture positive samples as a gold standard, the lack of comparative analysis with other commonly used biomarkers, and a lack of attention to the technical factors that could impact Xpert MTB/RIF performance, including PCR inhibition, level of detection, and correlation with bacterial load. Furthermore, there are also limited data from high TB and HIV prevalence settings.
To address these knowledge gaps we prospectively evaluated the performance of the Xpert MTB/RIF assay, and other same-day diagnostic biomarkers, using pleural fluid obtained from patients with suspected pleural TB from Cape Town in South Africa.
Methods
Patient recruitment, characterization and routine laboratory tests
Consecutive patients with suspected pleural TB, including any symptoms including cough, fever, night sweats, loss of weight, haemoptysis and chest pain, and features consistent with a pleural effusion on chest x-ray, were prospectively recruited from Groote Schuur, Somerset and Victoria Hospitals in Cape Town, South Africa, over a three year period from October 2009 to September 2012. The University of Cape Town Human Research Ethics Committee approved the study, and all patients provided written informed consent for study participation and pleural biopsy.
Routine TB diagnostic work up (pleural fluid analysis, sputum for microscopy and culture, when available, and lymph node or other organ biopsy) was performed by the referring physician. Although not routine, a closed pleural biopsy using an Abrams needle was performed by a study physician trained in this procedure to improve patient categorization. All biopsies were performed after aspiration of pleural fluid. Patients were offered voluntary HIV testing. Pleural fluid samples were collected for routine biochemical and cytological analysis (protein, albumin, ADA, glucose, cell differential, cytology), concentrated fluorescence smear microscopy, and liquid culture for
M. tuberculosis using the MGIT 960 (Becton Dickinson, Sparks, Maryland) with the remaining fluid used for Xpert MTB/RIF and IFN-γ analysis. Pleural biopsy samples were sent for histology and liquid culture. Adenosine deaminase activity in pleural fluid was determined by colorimetric technique by the National Health Laboratory Services, using the user-defined method on a Roche Cobas Integra (Roche Diagnostics Ltd, Switzerland). Pleural fluid ADA levels greater than 30 U/L, in keeping with local guidelines and clinical practice, were reported as suggestive of pleural TB [
18,
19].
Given the limitations of a single pleural fluid TB culture for confirming a diagnosis, patients were categorised as follows: Definite-TB: patients with at least one positive M. tuberculosis culture by liquid culture (in either pleural fluid, biopsy or sputum) and/or caseating granulomatous inflammation suggestive of TB on histological examination of pleural biopsy tissue, and with improvement on anti-TB treatment (all patients in this category received anti-TB treatment); Probable-TB: patients not meeting the criteria for definite-TB but with a clinical-radiological picture suggestive of TB and who were treated for TB with clinical response (all patients in this category received anti-TB treatment); Non-TB: patients for whom no microbiological or histological evidence of M. tuberculosis could be found, and/or for whom an alternative diagnosis was available. These patients at presentation and on follow-up did not receive anti-TB treatment.
All the laboratory staff performing the requested tests, including Xpert MTB/RIF and IFN-γ measurement, were blinded to all microbiological and clinical information.
IFN-γ measurement
Interferon gamma (IFN-γ) concentrations were measured in pleural fluid supernatant in duplicate using the InterGam Ultrasensitive Rapid Immuno-suspension Assay (IRISA; Antrum Biotech, Cape Town, South Africa; limit of detection = 5 to 10 pg/ml). Pleural fluid supernatant was prepared by centrifuging pleural fluid at 3000×g for 15 min to remove any unwanted debris.
Xpert MTB/RIF assay
A 1 ml aliquot of raw pleural fluid and a 1 ml aliquot of concentrated (centrifuged) pleural fluid from each patient was diluted with 2 ml of the Xpert MTB/RIF sample buffer. The 1 ml concentrated pleural fluid aliquot was prepared by centrifugation of a median (IQR) of 20 (10-20) ml pleural fluid at 3000×g for 15 min, with the supernatant discarded and the pellet made up to 1 ml with phosphate buffer solution. The pleural fluid and sample buffer solutions were then mixed vigorously and incubated at room temperature for 15 min, with further mixing halfway through the incubation. A 2 ml volume of the diluted samples was then transferred to an Xpert MTB/RIF cartridge and run on the GeneXpert (Cepheid, Dx System Version 4.0c) machine. The limit of detection was determined in duplicate by spiking 0, 50, 75, 100 and 150 H37Rv CFU to 1 ml aliquots of pleural fluid from subjects confirmed not to have TB, before dilution with sample buffer and subsequent Xpert MTB/RIF analysis. This experiment was repeated twice. Inhibition was evaluated by comparing the PCR cycle-threshold (CT) values of the internal positive control (lyophilized Bacillus atrophaeus subsp. globigii spores) from unconcentrated and concentrated samples.
Statistical analysis
Categorical variables were compared using the χ2 test and continuous variables were compared using Student’s t-test where appropriate, with Mann-Whitney used for non-parametrically distributed continuous variables. Correlations were analyzed using the Spearman co-efficient for non-parametrically distributed variables. Diagnostic accuracy, including 95% confidence intervals, was assessed using sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) (Open Epi, Version 2.3.1) and area under the receiver operator curve (AUROC) in definite-TB and non-TB groups (Graphpad Prism, Version 5.03).
Discussion
Given that a reliable same-day diagnostic tool for pleural TB is lacking, we prospectively evaluated and compared the use of ADA, IFN-γ and Xpert MTB/RIF using pleural fluid from patients with suspected TB. Our key findings were (i) Xpert MTB/RIF had poor sensitivity and this was neither the result of a sub-optimal level of detection compared to other types of biological samples nor increased PCR inhibition, (ii) Xpert MTB/RIF sensitivity was not improved by concentrating larger volumes of pleural fluid, (iii) ADA and IFN-γ are good rule-in tests for TB pleural effusions but the higher sensitivity of IFN-γ would be preferable over ADA for rule-in, particularly in low-burden settings where a high INF-γ level is unlikely to be due to cancer, (iv) the excellent rapid rule-out value of IFN-γ, compared to ADA, is of particular clinical usefulness in high burden settings as it could be used to prompt a search for an alternative diagnosis and hence medical or surgical biopsy. The sheer burden of disease and resource constraints, including lack of skilled operators, in high burden settings means that a routine biopsy-based approach cannot be undertaken. Moreover, the majority of patients suspected with pleural TB were unable to produce sputum.
The Xpert MTB/RIF assay, which can simultaneously detect the presence of
M. tuberculosis and rifampicin resistance in sputum specimens, has shown great promise in the rapid diagnosis of TB, with an average sensitivity and specificity of 90.4% and 98.4%, respectively [
8]. It has also improved the rapid diagnosis of pulmonary TB (sensitivity of ~68%) in smear-negative patients and recently been endorsed by the Scientific and Technical Advisory Board of the WHO for use in paucibacillary samples [
9,
20]. However, there are hardly any data about Xpert performance in pleural fluid. Published studies have generally been performed in low burden settings as a laboratory exercise reporting yields in samples from extra-pulmonary sites, and only reported on a handful of patients with TB pleural effusion [
10,
12‐
16]. This may explain the high sensitivity reported in these studies (range 58% to 100%) and high specificities (87% to 100%) [
10‐
16]. Recently Friedrich and co-workers in a selected cohort found that 20 out of 25 patients had confirmed TB and that Xpert sensitivity was 25% [
11]. We have confirmed these findings in a larger unselected cohort and further interrogated the technical performance of the assay. The level of detection was ≥75 colony forming units per ml, and there was no evidence of PCR inhibition using the internal positive control. Centrifugation of pleural fluid made little difference. The time to positivity data (median > 28 days) confirms the low organism load within the pleural space compared to pleural tissue. Indeed, there was a trend to shorter time to positivity in liquid culture from samples that were culture positive/Xpert positive compared to those that were culture positive/Xpert negative (data not shown). Collectively, these data confirm the notion that pleural TB is a paucibaciliary disease and thus concentration/ centrifugation of at least 20 ml of pleural fluid makes little difference to diagnostic yield. Xpert performed better in HIV-infected individuals, which may reflect a higher organism load in the pleural fluid [
21].
In high burden settings such as South Africa, a high ADA level is frequently used to guide initiation of anti-TB therapy [
4,
5]. In this study, although ADA levels were 5 times higher in TB patients than in non-TB patients, using the laboratory accepted cut-point in Cape Town (30 U/L) roughly 20% of TB patients would have been missed and 1 in 10 incorrectly started on anti-TB therapy. Despite the inability of ADA to definitively confirm
M. tuberculosis, it is a low cost and relatively rapid (same day) assay and has a high PPV when disease prevalence is high [
22]. In low prevalence settings, however, PPV is too low to be clinically useful. Indeed, a recent meta-analysis of 63 studies including 2796 pleural TB patients and 5297 non-TB patients reported the sensitivity of ADA to be 92% and specificity 90% at a cut-point of 41.9 U/L (median cut-point in the pooled studies, which each used a different cut-point) [
4]. Thus, 1 in 10 patients would be over diagnosed with TB. The specificity of ADA may be improved if the proportion of lymphocytes is taken into account as was recently shown [
22]. However, this is not universally helpful as about ~25% of TB pleural effusions , may be neutrophil predominant [
23].
Interferon gamma, similarly, was significantly higher in TB (100 fold) compared to non-TB patients. Using an ROC curve-determined cut-point of 107.7 pg/ml, only 3 definite-TB patients were missed. By contrast, Xpert sensitivity, like pleural fluid culture (~40%) [
2], was poor and therefore additional tools are required for optimal diagnosis when a non-biopsy approach is used. Thus, a ‘one size fits all’ approach with Xpert is inappropriate. Although closed pleural biopsy has a high diagnostic yield it is often unavailable in resource-poor settings, and even when available the large numbers of cases preclude routine biopsy in district general hospitals. In this study we have confirmed our previous findings, and those of others, that IFN-γ is both a highly accurate rule-in and rule-out diagnostic test for pleural TB [
6,
24‐
26], however it must be accepted that the 107.7 pg/ml cut point was generated using the current cohort and further prospective testing is required to confirm the high sensitivity and specificity. Although it can be easily measured by a commercially available ELISA-kit, it is not routinely performed due to the high cost and the kits only being available in a 96 well format, which lead to a considerable wastage of unused wells [
27]. Interestingly, of the only two non-TB patients that had elevated IFN-γ, one patient had an empyema, which is known to cause elevated IFN-γ and is a contra-indication to using the test, and the other patient was lost to follow-up and thus the true TB status was unclear. A previous study from our group demonstrated a similar accuracy (sensitivity 97% specificity 98%) [
6]. An obvious drawback is the lack of susceptibility data, but in resource-poor settings culture confirmation with susceptibility can follow if there is a poor response to treatment. In any event a culture isolate or positive NAAT would be required to determine susceptibility- the yield of both are low in pleural TB. It would have been interesting to perform Xpert on the pleural tissue biopsies but technically this was not feasible due to the limited amount of tissue and potential for tube blockage in the machine when solid material is used. However this may not have improved the diagnostic accuracy, in a recent study, Xpert was unable to detect any TB cases and more indeterminate results occurred when performed on finely ground pleural tissue [
17].
Affordability and cost effectiveness remains an important consideration in resource poor TB endemic countries. A comprehensive cost effectiveness analysis was beyond the scope of this paper, and we were unable to perform a simple cost analysis given the lack of a clinically validated commercially available unstimulated interferon gamma assay. Although the GeneXpert MTB/RIF assay is now being rolled out in many TB endemic countries [
28], as we have demonstrated, sensitivity is largely sub-optimal [
6,
29]. Although ADA is widely available, specificity may also be also sub-optimal, as we and others have previously demonstrated. Nevertheless, it remains a widely available relatively low cost test. Diagnosing drug-resistant pleural TB also merits cost consideration. However, the GeneXpert MTB/RIF assay has a poor sensitivity in this context and thus whatever diagnostic modality is used (unstimulated interferon gamma, ADA, or GeneXpert MTB/RIF) pleural tissue or fluid culture is still required for susceptibility testing. There is an urgent need to make available a commercially and clinically validated, relatively rapid, single patient use assay for the measurement of unstimulated interferon gamma levels in pleural fluid and other forms of EPTB.
There are several limitations of our study. There were a low proportion of HIV-infected patients and several patients with unknown HIV status. However, HIV prevalence rates in TB patients in the Western Cape Province of SA are known to be lower than in the rest of the country [
30], and patients often refuse testing. We only centrifuged 20 ml of fluid. However, we were limited by available sample, particularly when effusions were loculated. Moreover, a recent paper has showed that increasing the pleural fluid volume to 100 ml does not improve culture yields, despite improving the time to positivity [
21]. The conclusions drawn here apply to high TB and HIV burden settings and, for the sake of external validity, require confirmation in other settings. However, given that HIV increases the concentration of organisms in pleural fluid and that the upper limit of the Xpert sensitivity (95% CI) was 37% suggests that Xpert is unlikely to perform well in any setting when using pleural fluid. We did not evaluate the potential impact on morbidity and length of hospital stay of ADA, IFN-γ and Xpert compared to empiric treatment based on laboratory analysis alone (lymphocyte predominance), however, this would have require a randomized design and up to ~25% of TB effusions are known to be neutrophil pre-dominant [
23]. The confidence intervals of the sensitivity estimates for interferon gamma and the GeneXpert MTB/ RIF assay are not ideal and therefore our findings should be confirmed using larger sample numbers and from different parts of the world.
Competing interests
KD, UG and GT have performed consultancy work for Antrum Biotech (Pty) Ltd, a UCT co-owned spin-off company, and kits for the study were donated by the company. However, Antrum Biotech played no role in study design, data analysis or its publication. Similarly, KD has been the recipient of grant funding from FIND Diagnostics, who also donated Xpert MTB/RIF cartridges to carry out the study but FIND played no role in study design, data analysis or its publication.
Authors’ contributions
Concept and design, KD, RM, GT, JP. Laboratory experiments, RM, AB. Analysis and interpretation, RM, RvZS, JP, GC, GS, GN, BA, HK. Drafting the manuscript for important intellectual content, KD, RM, RvZS, GT, JP, UG. All authors read and approved the final manuscript.