Predictors of atrial fibrillation early recurrence following cryoballoon ablation of pulmonary veins using statistical assessment and machine learning algorithms

The study consisted of 118 consecutive patients with paroxysmal and permanent AF who were referred to the department of cardiology in Nowa Sól, Poland from May 2016 till September 2017 to undergo their first pulmonary vein isolation (PVI) performed through CBA (Arctic Front Advance 2nd generation 28 mm) in accordance with international guidelines.

Paroxysmal AF was defined as a self-terminating episode which lasted for up to 7 days while persistent AF occurred if arrhythmia took at least 7 days and could require cardioversion. The inclusion criteria were as follows: age > 18, no PVI attempt. Exclusion criteria included: intracardiac thrombi, myocardial infarction or cardiac surgery in the previous 3 months, autoimmune or inflammatory diseases, chronic renal failure, malignancies and previous AF ablation.

ERAF was marked as at least 30-s symptomatic or asymptomatic atrial tachyarrhythmias (AF, atrial tachycardia [AT] or atrial flutter [AFL]) that occurred after catheter ablation. An episode of ERAF on ECG and Holter monitoring was always documented within the first 3 months after the procedure.

Clinical and demographic parameters included: age, sex and comorbidities such as coronary heart disease, hypertension, thyroid diseases, dyslipidemia, diabetes mellitus, impaired glucose tolerance (IGT), impaired fasting glucose (IFG) and valvular heart disease.

All patients who took part in the study signed a written consent while the study protocol was approved by the Medical Ethics Committee of the Poznań University of Medical Sciences.

Transthoracic echocardiography (TTE) was performed in compliance with European guidelines before the procedure (iE 33, Philips Medical Systems, MA, USA). Transesophageal echocardiography (TEE) was performed 48 h before ablation to exclude thrombus in the left atrial appendage (Epiq 7, Philips Medical Systems, MA, USA). In addition, computed tomography (CT) was required to scrutinize the LA and PVs anatomy. The LA volume was indicated using biplane disk summation while blood pressure was measured in a supine position.

CBA is a single-shot procedure performed by pressurized cryorefrigerant (liquid nitrous oxide) delivered by cryoconsole. Before the procedure the patients had to continue oral anticoagulation (Warfin, Acenokumarol). Dabigatran and Xarelto were withdrawn 24 h before the procedure depending on the patient’s kidney function. All ablation procedures were performed under conscious sedation. The patients had a groin entry venous route catheter introduction with the transseptal puncture performed by means of a Brockenbrough needle (St. Jude Medical). In addition, a 15 Fr steerable sheath (FlexCath Advance, Medtronic) and an integrated inner-lumen circular mapping catheter (CMC, Achieve™; Medtronic, Inc.) were applied. Each freeze was preceded by an occlusion of pulmonary veins which was verified by an injection of contrast medium.

The application time constituted 240 s. The pulmonary veins potentials were recorded before ablation and then compared with the results obtained after the procedure. The final effect was defined as the lack of all pulmonary veins potentials, which was confirmed by a two-directional blockade in a mapping catheter. In the instance when the pulmonary veins potentials could not be recorded, the PV isolation was verified by withdrawing the catheter and placing it in an ostial position. Additional linear lesions and focal deliveries were not performed and adenosine testing was not used.

CBA was performed with a heparin administration following a transseptal puncture and adjusted to maintain the activated clotting time (ACT) for at least 300–350 s throughout the procedure. To avoid phrenic nerve injury (PNI) during the right-sided PVs ablation, phrenic nerve function was monitored by diaphragmatic stimulation which paced the ipsilateral phrenic nerve 30 times per min.

Venous blood was drawn from a basilica vein to determine the peripheral blood count and the levels of C-reactive protein (CRP), troponin-T (TnT), creatine kinase (CK), creatine kinase-MB (CK-MB), D-dimer, fibrinogen and INR. All tests were carried out at baseline and 24 h after CBA by means of standard laboratory kits.

In the analysis the peripheral blood count was marked with CELL-DYN Ruby (Abbott Diagnostics, USA). D-dimer, Fibrinogen, INR and aPTT were tested using STA-Compact Max (Stago, USA). TnT was marked with a Cobas 6000 device (Roche Diagnostics GmbH) with a cut-off value 14 pg/l. Creatinine, potassium, sodium, transaminases, CRP, CK and CK-MB concentrations were analysed by means of photometric Test (Roche Diagnostics GmbH). Normal reference ranges were as follows: WBC, 4.0–10.0 (× 10⁹/l), Fibrinogen 200–400 mg/dl; CK 0-190 U/l and CK-MB 7–25 U/l. The CRP cut-off value was 0.5 mg/dl while the D-dimer cut-off value equalled 0.5 µg/ml. The extent of biomarker elevation was defined as the post-procedure recorded value minus the baseline value (day 0).

The patients were monitored for the first 24 h after CBA. TTE was performed to exclude pericardial effusion. A follow-up examination was scheduled at the outpatient clinic within 3 months when a 24 h-Holter monitoring was carried out. Additional ECG was performed when the patient was symptomatic.

Oral anticoagulants (OA) and AADs were continued for 2–3 months after CBA. AADs were continued in case of atrial tachyarrhythmia recurrence after 3 months following the procedure. The decision regarding the continuation of OA was based on the patient’s individual stroke risk determined by CHA₂DS₂-VASc score.

Normality was verified by the Shapiro–Wilk test. Normally distributed variables were compared by means of the Student’s t test for two independent and dependent variables. The Mann–Whitney test was used for two independent variables not normally distributed while the Sign test and Wilcoxon matched pairs test were used for two dependent variables. Based on the results from univariate analysis, we performed multivariate analysis using a logistic regression model. McNemar’s test was used on the paired nominal data with contingency tables. Quantitative variables were expressed as a mean and standard deviation or median and interquartile ranges for normal and non-normal distribution of variables, respectively. A p value < 0.05 indicated the statistical significance.

The multivariate analysis was performed to identify the predictors of ERAF. Each analysis was performed using STATISTICA 8.0 software (Statsoft, USA).

To gain more insight into the issue broached here, we can reformulate the problem of finding relevant factors triggering ERAF to predict the probability of patients experiencing ERAF. ML algorithms allow for obtaining probability predictions of ERAF for individual patients. They also evaluate the significance of individual factors. Thus, two classification algorithms were used for predicting the probability of ERAF: support vector machines (SVM), gradient boosted trees [8, 9]. Both of these models were trained in a supervised fashion, classifying patients to two separate categories. The SVM algorithm was maximizing the gap between two different groups of data-points (patients) while the gradient boosted trees algorithm formed an ensemble of decision trees to gauge which category the analyzed data-point belonged to. The final classifiers were trained on the reduced set of seven variables, which played an important role in predicting ERAF. Due to the imbalanced classes representation, the synthetic minority over-sampling technique (SMOTE) was used to provide a balanced training data set [10]. Higher classification weights for positive examples were added to further improve the sensitivity of the model.

A total of 118 consecutive patients (37% women, age 62.7 ± 7.8 years, 54.2% with paroxysmal AF) with symptomatic, drug refractory AF were studied. ERAF occurred in 21 (17.8%) patients within the first 3 months after the procedure. A 3-month follow-up was completed in case of all patients. Baseline demographic, clinical and laboratory characteristics have been summarised in Table 1.

The majority of patients had hypertension (80.0%). Diabetes mellitus, coronary artery disease, dyslipidemia, moderate valvular heart disease were present in 22.9%, 19.5%, 16.9% and 14.4% of patients, respectively. The mean CHA₂DS₂-VASC score was 2.1 ± 1.1 while the mean HAS-BLED score was 1.4 ± 0.8. Complications related to CBA included: transient phrenic nerve palsy which occurred in nine patients (7.6%) and a thromboembolic event which affected 1 patient (0.8%) in the follow-up.

As shown in Table 2 patients with ERAF had significantly decreased TnT, CK-MB levels, the extent of TnT elevation and RR diastolic pressure following CBA. Lowered INR was noted in patients with ERAF before CBA, which contrasted with those who remained in sinus rhythm (p < 0.05).

There was a tendency for a lower fluoroscopy time in patients without ERAF [13.5 ± 5.6 without ERAF vs 15.8 ± 5.4 with ERAF (p = 0.08)] which was presented in Table 3.

Multivariate analysis was performed using logistic regression. The model included CK-MB, TnT following CBA and TnT elevation. The results showed no significant influence of these factors on ERAF.

Comorbidities such as diabetes mellitus and prediabetes (IGT and IFG) were significantly more frequent in patients with ERAF as opposed to patients without it. Patients treated with statins had a more significantly increased risk of ERAF than those who did not receive statins. AADs treatment (amiodarone and propafenone) did not affect ERAF after CBA. Other medications such as beta-blockers, oral anticoagulants, angiotensin converting enzyme inhibitors (ACE-I) and angiotensin II receptor blockers (ARB) were not associated with ERAF.

All of the employed algorithms suffered initially from overfitting due to imbalanced classes. Thanks to weight scaling and over-sampling, gradient boosted random trees and SVM allowed for substantially improving the sensitivity score. Nevertheless, all three models had moderate specificity and sensitivity for predicting ERAF. The best SVM algorithm obtained F1-score of 0.33. Additionally, we observed high variability of the results given different data splits. Thus, we restrict our analysis to identifying what factors are most important for performing classification. To obtain perfect sensitivity at least during the training time, we penalised false negative errors in the classification loss. This allowed us to identify the most important factors for predicting ERAF. The initial analysis suggested that out of 56 numerical variables only seven of them played an important role in predicting ERAF: TnT elevation, fluoroscopy time (min), LA Volume, PLT, TnT, CK-MB and CPK following CBA and TSH, INR before ablation (Fig. 1).

In this study, the univariate analysis of the data identified that CK-MB and TnT after ablation with the TnT elevation were the independent predictors of ERAF following single CBA. Comorbidities such as diabetes mellitus and prediabetes were also significant ERAF predictors. It was noted that the patients treated with statins had a substantially increased risk of ERAF as opposed to those who did not have statins prescribed. Furthermore, the results in the univariate analysis indicated that Troponin T (p = 0.043), and CK-MB (p = 0.010) after ablation as well as TnT elevation (p = 0.044) and INR before ablation (p = 0.012) were associated with ERAF. This low myocardial biomarker release could be associated with lower lesion dimensions, and thus worse efficacy of the procedure. Therefore, the biomarker release could indirectly help to estimate cardiac lesion formation. The longer cryoenergy application time in the ERAF group could be the result of difficult PV anatomy and the poor cryoballoon contact.

Interestingly, several similar studies investigating the relation between myocardial injury biomarkers (CK, CK-MB, Tn) and ERAF have been conducted. For example, Kizilirmak et al. [11] reported that the elevation in CK, CK-MB, and Troponin I levels following CBA was associated with a lower ERAF rate as indicated in 3-month, 6-month and 9-month follow-up visits. Additionally, the increased levels of TnI were correlated with the median temperature. In the multivariate analysis only TnI elevation was the negative independent predictor of AF recurrence (specificity of 90.7% and a sensitivity of 64.3%; AUC 0.816, 95% CI 0.691–0.906). Another study carried out by Aksu et al. [12] showed that the lower postablation hsTnT level may predict an increased ERAF rate (p = 0.012). Lim et al. [13], similarly, found that the extent of TnT elevation as well as hsCRP predicted ERAF within 3 days after ablation but not following 3 months or 6 months. In the study of Casella et al. [14], by contrast, no significant association was observed between postprocedural TnI, CK-MB levels and ERAF in a 1-month, 3-month, 6-month and 12-month follow-up.

Our analysis has further revealed that the patients with diabetes or in a prediabetes condition had a significantly increased risk of ERAF. Other studies conducted so far have not been able to conclusively estimate the risk of ERAF in this group of patients given conflicting results. Nevertheless, in Chao’s et al. [15] research it was shown that patients with abnormal glucose metabolism had a greater AF recurrence rate after catheter ablation than those without it (18.5% vs 8.0%; p = 0.022). These findings were explained by changes in biatrial substrate properties with an intra-atrial conduction delay and a decreased voltage. It is worth noting that in Cai’s investigation [16] and D’Ascenzo’s et al. [17] meta analysis diabetes correlated with ERAF but not independently of other cardiovascular risk factors.

Apart from the correlation with diabetes, our results have also indicated that preablative intake of statins was more common in the group of patients with ERAF (p = 0.0007). The benefit of statin treatment proved to be significant in the prevention of postoperative AF and after electrical cardioversion. Nevertheless, previous studies on statin therapy designed to prevent AF recurrence after catheter ablation come to contradictory conclusions. In Sulaiman’s double blind placebo randomized trial it was found that an 80 mg dose of atorvastatin did not decrease ERAF risk in the first 3 months after the procedure [18]. In addition, in Dentali’s et al. [19] metaanalysis statins did not reduce ERAF risk after catheter ablation (RR 1.04; 95% CI 0.85–1.28, p = 0.71; I² = 34%). It appears that larger randomized control trials are required to elucidate these results and obtain more conclusive data. Another finding relates to the pathophysiology of ERAF which depends on many factors. It has been demonstrated that ERAF within the first 3 months after ablation, called also “the blanking period,” is possibly associated with the inflammatory response, incomplete lesion healing, and autonomic nervous system (ANS) modulation [2]. Themistoclakis et al. [20] showed that longer AF duration, history of hypertension, left atrial enlargement, permanent AF were significantly associated with ERAF. Likewise, Bertaglia et al. [21] in their research pointed out that the structural heart disease and the lack of successful anatomical ablation of all targeted PV predicted early atrial tachyarrhythmias recurrence. Lee et al. [22], by contrast, showed that the presence of multiple AF foci could predict ERAF (p = 0.013; ratio = 2.24; 95% CI 1.18–4.25). Other research sources provide scoring systems with AF predicators which can foresee the short term AF recurrence risk (i.e. the APPLE, ALARMc, BASE-AF2) and long term recurrence risk (i.e. MB-LATER, CAAP-AF, PLAAF) following ablation [23].

However, it is still necessary to define the ERAF predictors which would allow for a better prevention system and a more suitable selection of patients susceptible to late AF recurrence. The statistical analysis and ML algorithms of so many parameters may facilitate such a selection prior the procedure, and thus increase its effectiveness. Identifying the patients with ERAF will help devise a better strategy to monitor the heart rhythm following 3 months since the CBA procedure and tailor further anticoagulant and antiarrhythmic treatment. Some factors related to predicting ERAF can also be directly linked to late and very late AF recurrence, which requires further research.

The classification analysis confirmed the finding from the univariate analysis. TnT and CK-MB provide most information for predicting ERAF. Although classification modelling confirmed findings from the statistical analysis, all models provide unsatisfactory accuracy. This, in our view, is mostly due to the small data set. We believe that the performance of analysed algorithms can be greatly improved with a bigger size of the data which we hope to expand in the future.