Methods
Objectives
The main objective of the present work was to evaluate the benefit of systematic central review by regional and national experts of all sarcoma cases diagnosed in the Rhône-Alpes region (RA). All sarcoma cases diagnosed by pathologists of the region were reported, and data were statistically analyzed to quantify inter-observer differences and determine their nature.
Description of the Region
RA is the second largest region in France, with nearly 6 million inhabitants and 8 departements (i.e. the administrative and geographical unit in France). It has 15 public structures (3 university hospitals, 1 cancer center, 11 general hospitals) with 59 pathologists and 28 private structures with 80 pathologists.
Patient selection
To be eligible, patients had to meet the following inclusion criteria: first diagnosis of connective tissue tumor, according to the 2002 WHO definition, and no previous treatment, first sarcoma diagnosis between March 1, 2005 and February 28, 2006 in RA region, all disease stages, and age ≥ 15 years. Exclusion criteria were as follows: diagnosis of relapse or a diagnosis other than sarcoma (i.e. low grade phyllodes tumor). Similarly, patients were not included when primary diagnosis had been established in the reference center (Leon Berard Cancer Center) by one of the 'experts' or if the tumor specimen was not sent to the expert or when there was not enough tumor material. In order to include patients and assess the concordance our study obtained an ethical approval by a review board (CNIL: Commission Nationale de l'information et des libertés. Independent administrative authority protecting privacy and personal data). The evaluation of medical records has been made through clinical audit
Study design
The goal of this study was to compare initial histological evaluation by the diagnostic pathologist (generally not an expert on these diseases) and results of the central expert review (CER) by two regional and national exclusively soft tissue experts. These two experts, members of the French Sarcoma Group (FSG), were selected by the EMS project scientific committee. All pathologists working in the region agreed to cooperate. All suspected cases of sarcoma (soft tissue, bone and visceral tissue sarcoma; n = 671) diagnosed during the reference period were collected [
14].
For each patient, a copy of the original histology report and histopathological specimens (Hemalin Eosin Safran (HES) and paraffin-embedded tissue) representative of the tumor sample were provided.
The diagnostic pathologist was offered financial compensation for each patient included (50 euros). For all included patients, immunohistochemistry (and/or molecular biology analysis) was performed by the referent pathologist.
Exhaustiveness control
To ensure exhaustiveness, several controls were established throughout the study by comparing the registered patients with the complete list of: 1) sarcomas reviewed by the expert pathologist every two months during the inclusion period; 2) medical files of the
multidisciplinary sarcoma committee and patients obtained from the Medical Information Department of the reference center; 3) pediatric patients with sarcoma to confirm the number of patients aged 15-18 and obtained from the pediatric registry of the RA region; 4) all sarcomas diagnosed by initial pathologists; then we excluded patients with exclusion criteria. After cross validation, only 5 additional patients were identified as missing and included [
15,
16].
Main outcome measure
Differences between the first diagnosis established by the non-expert pathologist and the second opinion given by experts were evaluated and scored on a three-point scale: The two experts evaluated in same time the diagnosis.
Zero agreement corresponded to cases where initial diagnosis was benign and final diagnosis was malignant (sarcoma) or conversely, or where the tumor was classified in different histological subtypes (i.e. synovialosarcoma vs. liposarcoma).
Partial agreement corresponded to cases where both pathologists diagnosed a sarcoma but with different histopathological grades, or with a different subtype (i.e. dedifferentiated liposarcoma vs. myxoid round cell liposarcoma).
Full agreement corresponded to cases where both observers gave identical diagnoses.
To define this score, the two experts must conclude to the same diagnose. In some rare cases and when the two experts did not have the same conclusion or if the diagnose was difficult the diagnosis was reexamined either by another expert (international expert Pr Fletcher) or/and discussed at monthly FSG pathologist meetings and a final consensus was determinated.
For all sarcoma types with mutation, a molecular biology was systematically assessed (FISH technic, PCR or DNA sequencing) to characterize the genetic alteration and confirm the diagnose. The Immunomarques were systematically done again by the expert
Grading system
The grading system of the French Sarcoma Group of the French Federation of Cancer Centers (FNCLCC) was used in this study as now proposed in the WHO classification [
17]. Grade was rated 'not applicable' for some specific histological types (e.g. Kaposi sarcoma) or when the grade could not be determined (biopsy specimen).
Subgroup analysis
For all included cases, the pathologist investigators were systematically offered an expert second opinion and the discrepancies were analyzed. However, two groups of patients were distinguished. The first one ("requested SO" group) corresponded to patients examined by a "non expert" pathologist who requested a second opinion from experts to confirm initial diagnosis. The second group ("control" group) included patients whose tumor samples were analyzed by a 'non expert' pathologist who did not request confirmation of diagnosis by experts and whose findings were reviewed only in the context of the present project but the results were not disclosed.
Statistical analysis
To evaluate patient characteristics and diagnostic concordance, categorical data were analyzed using Pearson's χ2-test or Fisher's exact test, as appropriate. Continuous data were analyzed with Student's t-test. The statistical significance level was set at p = 0.05 in a two-sided test.
Comparisons were also made between the "requested SO" group and controls. The χ
2 test was used to determine the rate of concordance and the types of discordance. Correlations between the most frequent causes of error and groups were analyzed using the Kappa test. For grading evaluation, a two by two table was constructed to compare original diagnosis against final diagnosis, both subsets being partitioned according to whether or not the diagnosis was the type of sarcoma under consideration. A Kappa test was used to measure agreement between initial diagnosis and expert review as compared to what would be expected by chance alone [
18,
19]. All analyses were performed using SPSS
® (version 12.0) and SAS
® softwares.
Discussion
Full concordance was reported for only 54% of cases included in this comprehensive cohort of sarcoma patients treated in RA in one year. Indeed, accurate diagnosis is essential to ensure appropriate management of patients with sarcoma, especially in the context of new targeted therapies. This study confirmed that centralized pathological review improves the quality of diagnosis in these rare tumors.
This study confirms that the diagnosis of sarcoma is very difficult to establish since more than 45% of first diagnoses were declared invalid by the panel of experts conducting the centralized pathological review. The major result was that concordance seems independent of the type of laboratory providing the primary diagnosis, the nature of the tumor samples or the tissue affected by the sarcoma (bone, soft tissue, viscera). The most frequent discrepancies identified were related to tumor grade and histological type. Exact determination of the tumor type and grade is crucial for making individual treatment decisions and subsequently improving patient outcome [
20,
21]. In fact, determining the grade of the tumor is essential to decide between adjuvant chemotherapy or not, neo-adjuvant chemotherapy or not, or radiotherapy or not. With the introduction of targeted treatments and the proliferation of clinical studies, patients whose grade has not been correctly evaluated may be excluded from trials [
20‐
23]. Although the clinical practice recommendations published in France have confirmed that the tumor grade must be included in the histological report generated at the time of diagnosis, this information is not always given, as confirmed in other studies demonstrating that the reproducibility of grade is very difficult to achieve [
20,
23‐
25]. On the other hand, when non expert pathologists participating in the study did grade a tumor, their evaluation was generally correct. Pathologists may sometimes lack experience and would benefit from training sessions organized in the framework of continuous medical education [
26].
Accurate determination of the type of sarcoma lesion is also crucial for correct patient management especially for differentiating between benign and malignant tumors, or between the different subtypes [
27]. Determining the grade of the tumor is more reproducible than characterizing its histological type which is the second cause of diagnostic discordance [
8]. The second cause of discrepancies concerned the histological type, and the central question that arises is whether all sarcoma cases should be reviewed in a specialized center. Importantly, all pathologists evaluating sarcoma patients should be able to use immunohistochemistry for confirmation of diagnosis. For certain histological types (GIST, Dermatofibrosarcoma protuberans...), molecular biology can also contribute to the establishment and/or the confirmation of diagnosis [
28‐
32]. Non concordance between first diagnosis and review seems very frequent for liposarcoma, PNET tumor and NOS sarcoma, and it is high for GIST and dermatofibrosarcoma protuberans for which specific markers are available. Similar results were reported by Harris et al, with a high degree of agreement for osteosarcoma and chondrosarcoma and low agreement for leiomyosarcoma and malignant fibrous histiocytoma [
27,
28].
In the literature, the rate of diagnostic errors in patients with soft tissue sarcoma is between 25% and 40%. [
6‐
10,
33‐
37], Surprisingly, since the first published reports on second opinion for sarcoma tumors in 1980, despite the introduction of new tools (immunochemistry, molecular biology etc.) and the development of educational workshops, the percentage of concordance has remained unchanged. Disagreements between diagnostic pathologists and expert panel members are inescapable (unrepresentative samples, heterogeneous tumors, misdiagnosis of grading...). In spite of the relatively high incidence of sarcoma, such variations in diagnosis will continue to occur and no significant convergence can be expected over time [
14]. Our comprehensive prospective study confirmed the results of previous retrospective studies, with inconsistencies between primary diagnosis and histological review in 45% of all cases. Our results revealed that diagnostic pathologists were often lack expertise in this disease or in other rare tumors. Thus, systematic expert second opinion seems essential [
35]. The inexperience of non-specialists with the multitude and complexity of soft tissue sarcomas is probably the most important factor accounting for diagnostic discrepancies [
27]. Actually, this question of centralized diagnosis is less relevant for tumors with more "standardized" diagnosis and management, like carcinoma or ovarian cancer [
38,
39].
In this study, 50% of the tumors were spontaneously addressed for a second opinion by the non-expert pathologist, versus only 40% in a previous study[
25]. All pathologists in the RA region took part in the study and full comprehensiveness was achieved. However, to achieve such a successful recruitment, many requirements must be met. In particular, there must be a key opinion leader and expert pathologist with recognized expertise in the field. Financial support to the pathologists participating in the study also seems essential. Finally, it is important, to keep the pathologists informed through regular meetings and newsletters. They must be involved and get feedback about the final diagnosis of their patient as well as about the advancement of the study. Cancer network participation can facilitate the involvement of pathologists and ensure exhaustiveness. It is well established in sarcoma pathology that "expert" opinion is not always absolutely convergent, though often different conceptualizations of a tumor do not necessarily generate different treatment implications. With the help of CONTICANET (CONnective TIssue CAncer NETwork), a similar prospective study has been initiated in the Aquitaine (France) and Venetia (Italy) regions to compare the rate of diagnostic discordance and confirm our conclusions. The correlation between concordance and free survival will be essentially evaluated on grade II/III tumors. The assessment of concordance is important for the patient for its impact on the diagnosis. The optimal diagnosis but also the optimum treatments (R0, radiotherapy decision) have an important role. Their prognostic value will be determinate in another article.
Acknowledgements
The authors are grateful to Marie-Dominique Reynaud for editing assistance, to the data managers Muriel Rogasik and Philippe Cousin, and to all pathologists of the Rhone-Alpes region for their active collaboration in the study:
Dr Agard Catherine, Dr Allias-Montmayeur Fabienne, Dr Angonin Régis, Dr Augros Marylin, Dr Bailly Christiane, Dr Balme Brigitte, Dr Bancel Brigitte, Dr Barnoud Raphaelle, Dr BenLagha Nadia, Dr Benabidallah Samir, Dr Berger Gerard, Dr Beschet Isabelle, Dr Beurlet Jacques, Dr Billard Françoise, Dr Bland Vincent, Dr Bonin Anne-Marie, Dr Bottero Noelle, Dr Bourloux Jocelyne, Dr Bouvier Raymonde, Dr Bozon Catherine, Dr Brambilla Elisabeth, Dr Bringeon Béatrice, Dr Buenerd Annie, Dr Cantero Brigitte, Dr Cavaillés Catherine, Dr Chalabreysse Lara, Dr Chalabreysse Philippe, Dr Chambonniere Marie-Laure, Dr Chanoz Jacques, Dr Chanoz-Poulard Geneviève, Dr Chassagne-Clément Catherine, Dr Chevallier Michèle, Dr Chouvet Brigitte, Dr Ciapa Agnès, Dr Claret-Tournier Catherine, Dr Clemenson Alix, Dr Collardeau Frachon Sophie, Dr Corrand-Faure Anne, Dr Corsois Laurent, Dr Crozes Carole, Dr Cruel Thierry, Dr David Catherine, Dr De la Fouchardiere Arnaud, Dr Decaussin-Petrucci Myriam, Dr Decouvelaere Anne-Valérie, Dr Denier Jean-François, Dr Der Garabedian Philiberte, Dr Derolland Philippe, Dr Descombes-Thivolet Brigitte, Dr Dieny Anne-Florence, Dr Dijoud Frederique, Dr Donne Chantal, Dr Donsbeck Anne-Valérie, Dr Douchet Catherine, Dr Dumollard Jean, Dr Dusserre Isabelle, Dr Economides-Jarsaillon Ariane, Dr Elbaz Nadine, Dr Fabre Blandine, Dr Faisant Monique, Dr Faure Anne, Dr Faure Claire, Dr Faysse Michaelie, Dr Feutry Catherine, Dr Fontaniere Bernard, Dr Frachon-Collardeau Sophie, Dr Gasnier Plaweski F, Dr Gentil-Perret Anne, Dr Glehen Alexandra, Dr Godard William, Dr Godeneche Janique, Dr Gouarderes Catherine, Dr Gouzy-Grosjean Fabienne, Dr Griot Annick, Dr Guillaubey Colette, Dr Guillaud Catherine, Dr Herve-Nicollet Catherine, Dr Hervieu Valérie, Dr Isaac Sylvie, Dr Istier Luc, Dr Jouvet Anne, Dr Kanitakis Jean, Dr Kermanac'h Pascale, Dr Khaddage Abir, Dr Klein Laurence, Dr Knopf Jean-François, Dr Koeb Marie-Hélène, Dr Labadie Michel, Dr Lantuejoul Sylvie, Dr Laurent Isabelle, Dr Lauro Carole, Dr Le Breton Frédérique, Dr Lucht-Versini Pascale, Dr Mabrut Marianne, Dr Machayekhi Jean-Pierre, Dr Maisonneuve Martine, Dr Maisonneuve-Gilly Dominique, Dr Mege-Lechevallier Florence, Dr Meyronet David, Dr Morcillo J-L, Dr Muller Bernard, Dr Muller Christine, Dr Neyra Monique, Dr Pasquier Dominique, Dr Perrot Guy, Dr Pialat Jean, Dr Picchetti Nicole, Dr Pinel Nicole, Dr Pocachard, Dr Pugens Gilles, Dr Ranchère-Vince Dominique, Dr Reis Borges Ruth, Dr Richard Jacques, Dr Roux Jean-Jacques, Dr Roux-Gilly Marie-Georges, Dr Saint Genis Luc, Dr Saint-Pierre Ghislaine, Dr Salameire Dimitri, Dr Salle Monique, Dr Salon Caroline, Dr Serain Francois, Dr Soubeyrand Marie-Sophie, Dr Streichenberger Nathalie, Dr Sturm Nathalie, Dr Suignard Yves, Dr Terdjman Pierre, Dr Treilleux Isabelle, Dr Vancina Serge, Dr Vaunois Brigitte, Dr Vercherin Axelle, Dr Vitetta Franck, Dr Vock-Bonnet Marthe, Dr Youssef Nelly, Pr Devouassoux Mojgan, Pr Pasquier Basile, Pr Peoc'h Michel, Pr Scoazec Jean-Yves, Pr Thivolet Bejoui Francoise.
Financial support: Merck Serono, National League against Cancer (Ain and Rhône committees), CONTICANET network.
Presented in part at 2008 CTOS.
Competing interests
I declare that all authors disclose any financial and personal relationships with other people or organisations that could inappropriately influence (bias) their work. We would like just specify that Dr Dominic Cellier is the scientific relationship director of Merck-Serono. Merck-Serono is our financial support.
Authors' contributions
AL: Data collection, data analyse, interpretation data, statistical analyse, article writing; FD: Data collection, data analyse, interpretation data, written participation; DR-V: Data collection, histological review, interpretation data, final article review; A-VD: Data collection, histological review, interpretation data, final article review; DC: Study design, administrative participation, final article review; FG: Data collection, administrative participation, final article review; DS: Data collection, data analyse, final article review; PB: Data collection, administrative participation, final article review; GDL: Data collection, administrative participation, final article review; J-YB: Project conception, study design, data collection, final article review; IR-C: Project conception, study design, data collection, statistical analyse, final article review. All authors read and approved the final manuscript