Many studies have investigated whether pleural cholesterol levels can aid in diagnosis of pleural exudates, and the results have varied considerably. To gain a more reliable answer to this question, we meta-analyzed the literature on using pleural cholesterol or the ratio of cholesterol in pleural fluid to cholesterol in serum (P/S cholesterol ratio) as diagnostic tests to help identify pleural exudates.
Methods
Literature databases were systematically searched for studies examining accuracy of pleural cholesterol or P/S cholesterol ratios for diagnosing pleural exudates. Data on sensitivity, specificity, positive/negative likelihood ratio (PLR/NLR), and diagnostic odds ratio (DOR) were pooled using bivariate-effects models. Summary receiver operating characteristic (SROC) curves and area under the curve (AUC) were used to summarize overall test performance.
Results
Our meta-analysis included up to 20 studies involving 3,496 subjects. Summary estimates for pleural cholesterol in the diagnosis of pleural exudates were as follows: sensitivity, 0.88 (95%CI 0.84 to 0.92); specificity, 0.96 (95% CI 0.92 to 0.98); PLR, 20.31 (95% CI 11.21 to 36.78); NLR, 0.12 (95% CI 0.09 to 0.17); DOR, 167.06 (95% CI 76.79 to 363.95); and AUC 0.97 (95% CI 0.95 to 0.98). The corresponding summary performance estimates for using the P/S cholesterol ratio were as follows: sensitivity, 0.94 (95% CI 0.92 to 0.96); specificity, 0.87 (95% CI 0.83 to 0.91); PLR 7.46 (95% CI, 5.47 to 10.19); NLR, 0.07 (95% CI 0.05 to 0.10); DOR, 107.74 (95% CI 60.91 to 190.60); and AUC 0.97 (95% CI 0.95 to 0.98).
Conclusions
Both pleural cholesterol level and the P/S cholesterol ratio are helpful for the diagnosis of pleural exudates. Nevertheless, the results of pleural cholesterol assays should be interpreted in parallel with the results of traditional tests and clinical information.
The online version of this article (doi:10.1186/1471-2466-14-61) contains supplementary material, which is available to authorized users.
Yongchun Shen, Hong Zhu contributed equally to this work.
Competing interests
All authors declare that they have no conflicts of interest or financial disclosures.
Authors’ contributions
YCS and HZ: conceived the article and contributed to the systematic review, meta-analysis, and manuscript writing. LC and Tao: contributed to the systematic review and manuscript writing. CW and TY: contributed to the systematic review and manuscript writing. FQW: guarantor of the manuscript who takes responsibility for the integrity of the work as a whole, from inception to published article. All authors read and approved the final manuscript.
Abkürzungen
P/S cholesterol ratio
Ratio of cholesterol level in pleural fluid to cholesterol level in serum
TP
True positive
FP
False positive
FN
False negative
TN
True negative
QUADAS
Quality assessment of diagnostic accuracy studies
SEN
Sensitivity
SPE
Specificity
SROC
Summary receiver operating characteristic
PLR
Positive likelihood ratio
NLR
Negative likelihood ratio
DOR
Diagnostic odds ratio
AUC
Area under the curve.
Background
Pleural effusion often develops in patients with thoracic or systemic diseases [1]. Such effusion has traditionally been classified as transudate or exudate based on the etiology and underlying pathology, and differentiating the two types of pleural effusion is critical for guiding treatment [2, 3]. Transudates are usually taken as a sign of underlying congestive heart failure, cirrhosis, or nephrosis, which then becomes the focus of treatment. Because in the case of a transudate, aetiology and therapy are directed to the underlying congestive heart failure, cirrhosis, or nephrosis. Alternatively, exudates are usually taken as a sign of, inflammatory disorders or malignancy, leading to more extensive diagnostic procedures [4, 5].
The criteria most widely used to differentiate exudates and transudates in patients with pleural effusions are Light's criteria, established by Light et al. in 1972 [6]. These criteria rely on levels of total protein and of lactate dehydrogenase [6]. The criteria maximize sensitivity at the expense of specificity: they typically identify 98% of pleural exudates, but they misclassify approximately 25% of transudates as exudates [7]. As a result, patients misclassified with exudate undergo unnecessary and risky invasive diagnostic procedures, such as thoracoscopic pleural biopsy and image-guided percutaneous pleural biopsy [8]. This highlights the need to develop better methods to differentiate exudative and transudative pleural effusions [9].
Anzeige
Since Light's criteria were published in 1972, pleural cholesterol levels have been explored for their usefulness in diagnosing pleural exudates. Cellular degeneration and vascular leakage due to increased permeability are thought to elevate pleural cholesterol levels [10]. Several studies suggest that pleural cholesterol is increased in pleural exudates, making it a potential biomarker for differentiating exudative and transudative pleural effusions [11]. Studies have come to conflicting conclusions about whether pleural cholesterol levels can provide adequate differentiating power, and other studies have explored the diagnostic potential of the ratio of cholesterol in pleural fluid to cholesterol in serum (P/S cholesterol ratio) and come to similarly conflicting conclusions [11]. To help gain more reliable insights, we meta-analyzed the literature on using pleural cholesterol level or the P/S cholesterol ratio to distinguish pleural exudates from transudates.
Methods
The present meta-analysis was performed using the guidelines of the Preferred Reporting Items for Systematic Reviews, as well as the Meta-analysis Statement and methods recommended by the Cochrane Diagnostic Test Accuracy Working Group [12]. Institutional review board approval was not required for this retrospective meta-analysis.
Two investigators (YCS and HZ) searched in PUBMED and EMBASE for relevant articles published up to October 2013 in which the following search terms were used as Medical Headings and/or text words: “cholesterol”, “pleural effusion”, and “pleural fluid”. The syntax for the PUBMED searches was as follows: “pleural effusion” OR “pleural fluid” AND “cholesterol”. Reference lists of the included studies and review articles were also checked to identify additional studies.
Studies were included if they fulfilled the following criteria: (1) they were original research articles published in English; (2) they examined the ability of pleural cholesterol level or P/S cholesterol ratio for differentiating pleural transudates and exudates in humans; and (3) they reported sufficient data to allow calculation of true positive (TP), false positive (FP), false negative (FN), and true negative (TN) rates. Conference proceedings and studies published only as abstracts were excluded. To avoid selection bias, we also excluded studies involving fewer than 20 patients.
Anzeige
Two reviewers (LC and TW) independently identified eligible studies and extracted data, with which they prepared 2 × 2 tables of diagnostic performance. In case of disagreement, the two reviewers arrived at a consensus. The quality of the selected studies was assessed using the 14-items Quality Assessment of Diagnostic Accuracy Studies (QUADAS) list [13].
Using bivariate regression, we calculated pooled estimates of sensitivity (SEN) and specificity (SPE) as the main outcome measures, and we constructed summary receiver operating characteristic (SROC) curves [14]. The bivariate approach investigates potential between-study heterogeneity and takes into account possible correlation between SEN and SPE. Based on the pooled estimates of SEN and SPE, we calculated positive likelihood ratios (PLR) and negative likelihood ratios (NLR). SEN and SPE estimates were paired to generate diagnostic odds ratios (DOR), which we used as an overall index of diagnostic accuracy. DOR relates the odds of positive test results in those with the condition with the odds of positive test results in those without the condition.
Heterogeneity was assessed using the I2 inconsistency test. I2 > 50% indicated substantial heterogeneity, which was then analyzed through subgroup analyses. The following covariates were clearly reported by more than 80% of included studies and so were analyzed as possible sources of heterogeneity: publication year (before 2000 vs. after 2000), design (cross sectional vs. non-cross sectional), data collection (prospective vs. retrospective), sampling method (consecutive/random vs. nonconsecutive/nonrandom/not reported), blinding (yes vs. no or not reported), detection method (enzymatic colorimetric method vs. other), sample size (<100 subjects vs. ≥ 100 subjects), QUADAS score (<9 vs. ≥9), and cholesterol cut-off value (60 mg/dl vs. other) [11].
Deeks’s funnel plot was used to detect publication bias [15]. Post-test probability (PTP) was calculated using the overall prevalence of 20% with Fagan nomograms. All analyses were performed using the “Midas” module in STATA 12.0 (Stata Corp., College Station, TX). All statistical tests were two-sided, with P values less than 0.05 taken as the threshold for statistical significance.
Results
After systematically searching literature databases and manually searching references lists in relevant reviews and studies, we included 20 studies examining the diagnostic accuracy of cholesterol levels in patients with pleural exudates [16‐35]. Studies were excluded mainly because they did not examine diagnostic performance, they did not report sufficient data to construct 2 × 2 tables, or they involved fewer than 20 patients. Figure 1 outlines the process of selecting studies.
×
Quality of reporting and study design
The final set of 20 studies involved 3,496 subjects, comprising 2,548 patients with pleural exudates and 948 with transudates. Of the included studies, 19 examined the ability of pleural cholesterol concentrations to distinguish exudates from transudates, while 13 examined the ability of the P/S cholesterol ratio to do this. Included studies were published between 1987 and 2013. In all included studies, most studies took into account the limitations of Light's criteria and therefore diagnosed exudative pleural effusion by combining Light's criteria with clinical information, treatment response, and other data, which is widely considered an acceptable basis for exudate diagnosis. Of the 20 studies, 12 had QUADAS scores ≥9. Tables 1 and 2 summarize the clinical characteristics of the patients in each study as well as the QUADAS scores for each publication.
Table 1
Clinical summary of included studies examining the diagnostic accuracy of pleural cholesterol level
Abbreviations: TP, no. of true positives; FP, no. of false positives; FN, no. of false negatives; NA, not applicable; TN, no. of true negatives.
Diagnostic accuracy of pleural cholesterol level
The following pooled parameters were calculated over all 19 studies examining pleural cholesterol concentrations for diagnosing exudates: SEN, 0.88 (95% CI: 0.84-0.91); SPE, 0.96 (95% CI: 0.92-0.98); PLR, 20.31 (95% CI: 11.21-36.78) (Figure 2); NLR, 0.12 (95% CI: 0.09-0.17) (Figure 2); and DOR, 167.06 (95% CI: 76.69-363.95). All five performance indices showed high I2 values: SEN, 91.13%; SPE, 74.31%; PLR, 63.7%; NLR, 91.96%; and DOR, 100% (all P < 0.05). This suggests substantial heterogeneity among the studies.
×
Figure 3 shows a plot of the rate of true positives as a function of the rate of false positives for individual studies, as well as the corresponding SROC curve. Using the bivariate approach, which estimates not only the strength but also the shape of the correlation between SEN and SPE, we plotted the observed and predicted ellipses at a 95% confidence level. The AUC was 0.97 (95% CI: 0.95-0.98), indicating a high discriminatory ability of pleural cholesterol. Fagan’s nomogram for likelihood ratios (Figure 4) indicated that using cholesterol to detect pleural exudates increased the post-probability to 83% when the results were positive and reduced the post-probability to 4% when the results were negative.
×
×
Anzeige
Diagnostic accuracy of the P/S cholesterol ratio
A total of 13 studies with 2,297 subjects examined the ability of the P/S cholesterol ratio to distinguish exudates from transudates. Table 3 summarizes the SEN, SPE, PLR, NLR, and DOR, while Figure 5 shows the SROC curve. The AUC was 0.97 (95% CI: 0.95-0.98), suggesting high overall accuracy.
Table 3
Summary characteristics of diagnostic performance of pleural cholesterol levels and ratio of cholesterol in pleural fluid to cholesterol in serum
Parameter
Pleural cholesterol concentrations
Pleural fluid to serum cholesterol ratio
Sensitivity
0.88
0.94
(95CI: 0.84-0.92)
(95CI: 0.92-0.96)
Specificity
0.96
0.87
(95CI: 0.92-0.98)
(95CI: 0.83-0.91)
PLR
20.31
7.46
(95CI: 11.21-36.78)
(95CI: 5.47-10.19)
NLR
0.12
0.07
(95CI: 0.09-0.17)
(95CI: 0.05-0.10)
DOR
167.06
107.74
(95CI: 76.69-363.95)
(95CI: 60.91-190.60)
PPP
84%
65%
PPN
3%
2%
AUC
0.97
0.97
(95CI: 0.95-0.98)
(95CI: 0.95-0.98)
×
Investigations of heterogeneity and publication bias
Significant heterogeneity was identified among included studies, so we performed subgroup analysis to investigate the possible sources of this heterogeneity. Table 4 summarizes the influence of certain covariates on the SEN and SPE. SPE was significantly higher with some covariates, such as QUADAS score or blinding. However, these covariates did not significantly affect SEN. Deeks’ funnel plot asymmetry test was used to assess likelihood of publication bias in the final set of studies. The slope coefficient was associated with a P value of 0.50, suggesting symmetry in the data and low likelihood of such bias (Figure 6).
Table 4
Subgroup analysis for sensitivity and specificity
Covariate
Sensitivity
Coefficient
Z
P
Specificity
Coefficient
Z
P
Publication year
0.90 (95% CI 0.84-0.94)
2.19
0.84
0.40
0.97 (95% CI 0.92-0.99)
3.39
0.93
0.35
Method
0.88 (95% CI 0.83-0.92)
2.01
−0.20
0.84
0.96 (95% CI 0.92-0.98)
3.07
−0.10
0.92
Cut-off value
0.86 (95% CI 0.80-0.91)
1.85
−0.96
0.34
0.96 (95% CI 0.91-0.98)
3.08
−0.02
0.99
QUADAS score
0.89 (95% CI 0.84-0.93)
2.07
0.34
0.74
0.98 (95% CI 0.95-0.99)
3.77
3.15
0.00
Sample size
0.87 (95% CI 0.82-0.91)
1.92
−1.03
0.30
0.95 (95% CI 0.91-0.98)
3.02
−0.36
0.72
Prospective
0.90 (95% CI 0.85-0.93)
2.18
1.08
0.28
0.95 (95% CI 0.90-0.98)
2.95
−0.64
0.52
Design
0.90 (95% CI 0.86-0.93)
2.22
1.70
0.09
0.94 (95% CI 0.90-0.97)
2.81
−1.42
0.16
Consecutive
0.87 (95% CI 0.82-0.91)
1.90
−1.50
0.13
0.95 (95% CI 0.91-0.97)
2.87
−1.56
0.12
Blinding
0.88 (95% CI 0.80-0.93)
1.99
−0.16
0.88
0.98 (95% CI 0.95-0.99)
3.95
2.00
0.05
×
Discussion
Despite the importance of defining the type of pleural effusion accurately, current methods lack the power to reliably differentiate pleural exudates from transudates [7]. Several studies suggest that pleural cholesterol levels and the P/S cholesterol ratio may be able to accomplish this, but the studies have given conflicting results. Our meta-analysis suggests that both pleural cholesterol level and P/S cholesterol ratio are useful as tools in the diagnosis of pleural exudates, though they probably cannot stand on their own and so should be used in conjunction with more traditional tests.
Our meta-analysis showed that pleural cholesterol level was associated with high SEN (0.88, 95% CI: 0.84-0.91) and SPE (0.96, 95% CI: 0.92-0.98). These findings suggest that pleural cholesterol may represent a new milestone in pleural exudate diagnosis. The SROC curve illustrates overall test performance, and shows the trade-off between SEN and SPE. Our SROC analysis showed an AUC of 0.97, suggesting high overall accuracy. Another indicator of diagnostic accuracy is DOR, which is the ratio of the odds of a true positive to the odds of a false positive; DOR combines SEN and SPE data into a single number ranging from 0 to infinity, with higher values indicating better discriminatory test performance. Mean DOR in our meta-analysis was 167.06, suggesting that assaying pleural cholesterol levels should be helpful in the diagnosis of pleural exudates.
Anzeige
We further examined the diagnostic accuracy of pleural cholesterol levels by calculating PLR and NLR, which can be easier to relate to clinical practice than SROC and DOR [36]. The pooled PLR value of 20.31 suggests that patients with pleural exudates have an approximately 20-fold higher chance of giving a positive pleural cholesterol test result than do patients without exudates. At the same time, the pooled NLR was 0.12, indicating that a negative pleural cholesterol test result is 12% likely to be a false negative, which is not low enough to rule out pleural exudates. This comprehensive analysis of the diagnostic accuracy of pleural cholesterol levels suggests that this indicator may not be reliable enough on its own but should instead be used in conjunction with other conventional tests. This unreliability may in part reflect the sensitivity of pleural cholesterol levels to differences in disease conditions, patient population, and environment.
Using the P/S cholesterol ratio instead of absolute cholesterol levels may help eliminate the effects of such factors to aid the diagnosis of pleural exudates. Our results revealed that P/S cholesterol ratio showed even higher SEN than pleural cholesterol levels (0.94, 95% CI: 0.92-0.96); in addition, the AUC was 0.97, suggesting that the P/S cholesterol ratio also shows high discriminatory ability.
Misclassification of transudates as exudates can lead to inappropriate patient management or potentially unnecessary and invasive diagnostic investigations that increase morbidity and health care costs [37]. Therefore we compared how often clinicians misclassified pleural transudates as exudates depending on whether they relied on pleural cholesterol levels or Light’s criteria (Table 1). Pleural cholesterol levels were associated with a significantly lower misclassification rate. We conclude that pleural cholesterol level shows substantial promise as a supplementary test for distinguishing pleural exudates from transudates.
While meta-analysis is well-suited for generating summary outcomes, the pooled results can mask heterogeneity that should be understood in detail [38]. Indeed we detected substantial heterogeneity across the included studies, and subgroup analyses suggest that differences in QUADAS score accounted for most of the observed SPE heterogeneity. Such differences did not, however, significantly affect SEN, suggesting that study quality had little influence on the TP rate of pleural cholesterol tests. Given the effect of study quality on SPE and the low QUADAS scores of several included studies, future studies should aim for greater rigor in order to decrease the risk of bias.
Anzeige
Our meta-analysis suggests an association between elevated pleural cholesterol and the presence of pleural exudates, which implies that cholesterol contributes to exudate pathogenesis. It is not immediately clear how this happens, so future research should examine this question in order to provide a biological basis for the observed association. Our meta-analysis also points out the need for investigating the effect of cut-off value on the diagnostic accuracy of pleural cholesterol levels. The values in our meta-analysis ranged from 38 to 65 mg/dl. This variation in cut-off value partly reflects differences in clinical context: a lower cut-off value is typically used for cardiac patients with pleural effusion than for patients in cancer institutes. Further work should aim to identify the cut-off value that provides optimal diagnostic accuracy [11].
The findings of this meta-analysis should be interpreted with caution because of several limitations. While our strict inclusion and exclusion criteria may have helped reduce selection bias, they led to a relatively small final set of studies for which statistical power may be inadequate for drawing definitive conclusions about the ability of pleural cholesterol levels to discriminate between exudates and transudates. For example, we included only studies published in English in a relatively small number of databases. Our results may be biased by our omission of unpublished studies, studies published in other languages and studies published in journals not indexed in the databases we searched.
Conclusions
Our meta-analysis suggests that assaying pleural cholesterol levels and the P/S cholesterol ratio may significantly aid the diagnosis of pleural exudates. In the near future, cholesterol-based assays may prove useful as a non-invasive confirmatory test to complement current screening procedures and as a rapid clinical test to guide the comprehensive management of patients with pleural effusion.
Acknowledgments
This work was supported by grants 81230001, 81301962 and 8130032 from the National Natural Science Foundation of China. We are indebted to the authors of the primary studies included in this meta-analysis; without their contributions, this work would not have been possible.
Open Access
This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License (
https://creativecommons.org/licenses/by/2.0
), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (
https://creativecommons.org/publicdomain/zero/1.0/
) applies to the data made available in this article, unless otherwise stated.
Competing interests
All authors declare that they have no conflicts of interest or financial disclosures.
Authors’ contributions
YCS and HZ: conceived the article and contributed to the systematic review, meta-analysis, and manuscript writing. LC and Tao: contributed to the systematic review and manuscript writing. CW and TY: contributed to the systematic review and manuscript writing. FQW: guarantor of the manuscript who takes responsibility for the integrity of the work as a whole, from inception to published article. All authors read and approved the final manuscript.