Introduction

For decades, the effort to reduce harm caused by smoking has focused on preventing smoking initiation and promoting smoking cessation; however, a consistent increase in the rate of cessation from 1991 to 2010 failed to be demonstrated (Zhu et al. 2012). The tobacco harm reduction approach, which is designed to reduce health risks associated with tobacco smoking, but may involve the continued use of nicotine (Cox and Dawkins 2018), has been increasingly proposed as a promising complementary strategy to accelerate the decline in smoking prevalence and to reduce the overall smoking-related population harm (WHO 2008). Modified risk tobacco products (Family Smoking Prevention and Tobacco Control Act 2009) are relevant to this effort; they should significantly reduce the harm and risk of smoking-related disease for individual smokers and improve the health of the population as a whole.

A recent study stated that electronic cigarettes (EC) “may be a unique harm reduction innovation for smoking relapse prevention” and that vaping can be a long-term substitute for cigarette smoking with “substantial implications for tobacco harm reduction” (Notley et al. 2018). Nonetheless, the safety of EC use is highly debated. ECs “are electrical devices that generate an aerosol from a liquid” (Bals et al. 2019). The liquid, generally referred to as e-liquid, is typically composed of humectants (e.g., propylene glycol [PG] and vegetable glycerin [VG]) and flavors, with or without nicotine (Grana et al. 2014; NAS 2018). With more than 8000 flavors now available on the market (Bals et al. 2019) and around 242 new flavors added every month (Tierney et al. 2016), the selection of e-liquids adequate for use with ECs should be driven by relevant toxicological analysis.

An earlier proposal promoted the selection of e-liquid ingredients with certain purity criteria and to avoid ingredients known to be carcinogenic, mutagenic, and reprotoxic (Costigan and Meredith 2015). The authors also suggested the exclusion of known respiratory sensitizers. A later proposal recommended the selection of ingredients based on their potential respiratory allergens (Costigan and Lopez-Belmonte 2017). Finally, a recent article suggested the use of Genomic Allergen Rapid Detection to classify and differentiate flavors based on their sensitizing potentials (Stevenson et al. 2019). In addition, our group has proposed a multi-layer systems toxicology framework for in vitro assessment of e-liquids that is meant to complement the battery of classical assays for mutagenicity and genotoxicity testing (Iskandar et al. 2016). Briefly, the first layer of the framework is aimed at screening e-liquids for potential toxicity using relevant 2-dimensional (2D) primary human cell culture systems. This is followed, in the second layer, by toxicity-related mechanistic investigations of selected e-liquids using culture systems similar to the one used in the first layer. Finally, the third layer of the framework focuses on toxicity-related mechanistic investigation of the corresponding aerosols using 3-dimensional (3D) airway culture systems grown at the air–liquid interface (ALI). This proposed framework advocates the use of in vitro test systems relevant for the inhalation route.

In the present work, we assessed whether the MESH Classic Tobacco e-liquid elicited lower biological effects than CS in vitro using the multi-layer systems toxicology framework outline above (Iskandar et al. 2016). The first and second layers of the assessment investigated the toxicity profiles of both the MESH Classic Tobacco e-liquid (containing PG, VG, nicotine, and flavors) and its corresponding Base e-liquid (containing only PG, VG, and nicotine without flavors) in comparison with the total particulate matter (TPM) of CS from the 3R4F reference cigarette using submerged 2D cultures of primary normal human bronchial epithelial (NHBE) cells. The third layer of the assessment focused on investigating the biological impact of the aerosols generated by the MESH EC device from both MESH Classic Tobacco and Base e-liquids in comparison with the impact of 3R4F CS using 3D ALI primary human buccal and small airway epithelial culture models. The aerosol was generated with an EC device based on the MESH technology (P4M3 generation 1.0, Philip Morris International).

Our choice of testing the impact of EC exposure on 2D bronchial and 3D small airway epithelial cultures may be obvious given the importance of the lung as the primary target organ upon inhalation exposure. However, studies have shown that gene expression changes in the upper respiratory tract (nasal epithelium) overlap with changes detected in the lower respiratory tract (bronchial epithelium) (Steiling et al. 2008). Furthermore, a recent study using multiscale computational fluid-particle dynamics model combined with a physiologically based toxicokinetic model also reported that EC aerosol particle deposition occurs not only in the respiratory tract, but also in the mouth (Haghnegahdar et al. 2018). Therefore, in the present work, we also tested the impact of the EC aerosol exposure on buccal epithelial cultures (part of the third layer of the framework). This approach is aligned with the National Institute of Dental and Craniofacial Research (NIDCR) Strategic Plan 2014–2019 and its initiatives in assessing the effects of EC aerosols on oral health. NIDCR recently noted the lack of studies investigating the effects of EC aerosol exposure on periodontal epithelial cells (NIDCR 2018).

Materials and methods

2D NHBE cells

NHBE cells were purchased from Lonza (Basel, Switzerland) and were derived from a healthy 60-year-old Caucasian male donor who was consuming alcohol (but not in a diseased state), with no history of smoking (Lot number 0000140733). The provider certified that the cells tested negative for mycoplasma, bacteria, yeast, and fungi, and that HIV-1, hepatitis B, and hepatitis C were not detected in the cell lot. For all experiments described here, we used cells between passages 5 and 8. Cells were cultured in a bronchial epithelial cell medium (Bullet Kit, catalog no CC-3170, Lonza, Cologne, Germany) as previously described (Gonzalez-Suarez et al. 2017).

E-liquid formulations

Two different formulations of e-liquid were tested using the primary 2D NHBE cells (Table 1).

Table 1 Composition of test e-liquids

3R4F CS TPM

TPM of 3R4F CS was prepared by collecting the mainstream smoke from the 3R4F reference cigarette on Cambridge glass fiber filters (44 mm diameter) following a previously published protocol (Gonzalez-Suarez et al. 2016). The mainstream smoke of 6 cigarettes was trapped in 2 separate glass fiber filters followed by extraction in a plastic vessel. The first filter was extracted with 5 mL ethanol, and the second filter was extracted with the first crude extract.

Real-time cell analysis (RTCA)-based data generation and analysis

2D NHBE cells were seeded into E-Plate View 96-well tissue culture plates (ACEA Biosciences, San Diego, CA, USA) at a density of 7.2 × 103 cells per well in 100 μL of culture medium and incubated at 37 ± 1 °C in a humidified incubator with 5.0 ± 0.5% CO2 for 24 ± 1 h. Cells were then exposed to different dilutions of each test solution (Fig. 1, First-Layer Assessment). A positive control (Triton X-100; T8787, Sigma-Aldrich, St. Louis, MO, USA) and negative control (cell culture medium) were included in each experiment. A set of 7 independent experiments was conducted to test 3R4F CS TPM, and 4 independent experiments were conducted to test MESH Classic Tobacco and Base liquids.

Fig. 1
figure 1

Experimental procedures and biological endpoints. Applying the first layer of the assessment framework (Iskandar et al. 2016), we examined the cytotoxicity effects of MESH Classic Tobacco and Base liquids compared with those of 3R4F CS TPM using 2D primary NHBE cultures (upper panel). Subsequently, in the second layer of the assessment, toxicity-related mechanistic evaluation of MESH Classic Tobacco and Base liquids, compared with 3R4F CS TPM, was conducted using high-content screening (HCS) assays on 2D primary NHBE cultures (middle panel). Finally, the third layer of the assessment investigated the biological impact of the MESH Classic Tobacco and Base aerosols compared with that of 3R4F CS using 3D human buccal and small airway epithelial cultures. *Various doses tested are given in Table 3. For the 3D buccal epithelial cultures, PRM was generated from samples collected at 24 h post-exposure. G, glycerol; p2HAX, phosphorylated H2A histone family member X; PG, propylene glycol; ROS, reactive oxygen species

Impedance was measured continuously using an xCELLigence RTCA® system (ACEA Biosciences, San Diego, CA, USA) from the timepoint of cell seeding until 24 h of exposure to the MESH Classic Tobacco liquid and its Base liquid. The resulting values were normalized to both the negative control and the positive control within the plate (2-point normalization) to obtain the relative cell viability (see Supplementary Materials and Methods).

Generation of high-content screening (HCS) data

2D NHBE cells were seeded into black, clear-bottom 96-well tissue culture plates at a density of 37,500 cells per cm2 (12,000 cells per well) in 100 µL of culture medium. The cells were incubated for 24 h in the culture medium and then exposed (in 2 replicate wells) to increasing concentrations of the tested solutions (Fig. 1, Second-Layer Assessment). The corresponding flavorless solution (Base liquid) was included as a reference. The cells were exposed for 4 and 24 h before performing the HCS assays (cell membrane permeability, cytochrome c release, DNA damage [pH2AX], glutathione (GSH) content, oxidative stress [ROS], stress kinase [c-Jun phosphorylation]) using various dyes and following previously published methods (Gonzalez-Suarez et al. 2016; Marescotti et al. 2016). A set of 3–8 independent experiments was conducted. A more detailed description of the protocol is provided in the Supplementary Materials and Methods.

HCS data processing

HCS assays (N = 3–8 independent experiments) generate multiple fluorescence readouts that are measured simultaneously. The quantification of fluorescence images was stored in the database linked to the GladiaTOX package (Belcastro et al. 2019), which extends the ToxCast analysis pipeline package (Filer et al. 2017). As a quality check, positive controls were first normalized against the corresponding vehicle (cell culture medium) and analyzed. Data (endpoints) that did not pass the quality criteria were masked. Raw data that passed the quality check were normalized to vehicle using the following equation:

$$ N\left( i \right) = \log_{2} \left( {\frac{i}{Veh}} \right), $$

where i is the measured raw signal value of a well, and Veh is the median of the measured signal values for the vehicle wells on a plate.

Dose–response curves were fitted on the normalized data using three function families: constant, Hill, and gain–loss functions. The best-fitting model of the three function families (minimizing the Akaike information criteria) was retained, and a minimum effective concentration (MEC), which was defined as the intersection of the fitted curve with the noise band, was calculated (Supplementary Fig. 1). The noise band was computed as three times the baseline median absolute deviation of vehicle responses. MEC values are not available for the constant model (the modeled activity never intersects the noise band). Missing MEC values were replaced by the value for the maximum tested concentration except if all replicates showed a constant signal.

3D human organotypic ALI buccal and small airway epithelial cultures

Organotypic human buccal epithelial (EpiOral™, MatTek Corp., Ashland, MA, USA) and small airway epithelial (SmallAir™, Epithelix. Geneva, Switzerland) cultures were used; each was reconstituted from the primary cells of a single donor (Table 2). We chose to use a single donor to reduce the influence of donor-to-donor variability and thus increase the statistical power to identify potential exposure effects, although we acknowledge that the results are limited to a donor-specific response. Buccal cultures were approximately 2 weeks after reconstruction before being used for the exposure experiment. Small airway cultures were approximately 5.5 weeks after air lift before being used for the exposure experiment. The cells were maintained according to previously published protocols (Iskandar et al. 2018; Zanetti et al. 2018). After exposure, the medium was not changed until the cultures were collected for various endpoint measurements (up to 48 h post-exposure [PE]).

Table 2 Human organotypic ALI buccal and small airway culture models

Generation of 3R4F CS and EC aerosols

Mainstream CS was generated from 3R4F reference cigarettes (Kentucky Tobacco Research & Development Center; University of Kentucky, Lexington, KY, USA) using a 30-port carousel smoking machine (SM2000; Philip Morris, International). Test aerosols were generated from the MESH Classic Tobacco or Base liquids using an EC device with MESH technology (P4M3 generation 1.0, Philip Morris International) in combination with single-programmable syringe pumps. The MESH technology maintains the temperature for the heater between 200 and 220 °C rather than varying the temperature depending on the puff strength. The particle sizes of 3R4F CS, MESH Classic Tobacco aerosol, and Base aerosol were similar; they were measured before entering the exposure system as a quality control following a previously published protocol (Iskandar et al. 2019); data are given Supplementary Table 1.

Exposure setup for the ALI cultures

We conducted a set of 3 experimental phases using buccal cultures and a set of 3 using small airway cultures. In each phase, in which 1 specific culture batch was used, 3 independent exposure experiments were conducted. Thus, a total of 9 independent exposure experiments were performed. The positioning of cultures (assigned for a given endpoint) in the exposure plate was changed from experiment-to-experiments to reduce allocation bias. VITROCELL® exposure systems (VITROCELL® 24/48; VITROCELL Systems GmbH, Waldkirch, Germany) were used to house the cultures during the exposure. In 1 exposure system, up to 48 cultures can be simultaneously exposed to smoke or aerosols. In each plate, we included the cultures that were exposed only to air (controls), thus generating paired samples (exposed vs. air-exposed control samples). Various endpoints were assessed following exposures (Fig. 1, Third-Layer Assessment). In addition to biological cultures, we included phosphate-buffered saline (PBS) in the exposure chamber that was used to measure the concentrations of deposited nicotine (100 µL PBS/well).

A 30-port carousel smoking machine (Philip Morris International) was connected to 1 dedicated VITROCELL® 24/48 exposure system. A total of 4 puffs/minute were taken consecutively from 2 cigarettes placed in the 30-port carousel. The puff generation from 1 cigarette was conducted for a puff volume of 55 mL, a puff duration of 2 s, and a puff interval of 30 s (Health Canada 1999), with an exhaust time of 8 s and with 100% blocking of the filter ventilation.

The single-programmable syringe pumps (for the generation of MESH Classic Tobacco and Base aerosols) were connected to another dedicated VITROCELL® 24/48 exposure system. Two EC devices of the same kind (i.e., containing MESH Classic Tobacco liquid or Base liquid) were connected to 1 pump; a pinch valve installed between the cartridges and the pump alternated the activation of the 2 devices, generating 1 puff every 15 s (a total of 4 puffs/minute were generated). The puff generation from 1 EC device was conducted for a puff volume of 55 mL, a puff duration of 3 s, and a puff interval of 30 s (CORESTA 2015), with an exhaust time of 8 s.

Doses of 3R4F CS, MESH Classic Tobacco aerosol, and Base aerosol applied to the cultures are summarized in Table 3. The concentrations of 3R4F CS (112-puff exposure = 28-min exposure) were chosen based on the observations in our previous studies, where we could detect a wide range of toxic response, from subtoxic to toxic (Iskandar et al. 2018; Zanetti et al. 2018). Because this is a comparative assessment in which the impact of MESH Classic Tobacco or Base aerosols was compared with that of 3R4F CS, the doses chosen for MESH Classic Tobacco and Base aerosols were those resulting in a similar and/or higher nicotine concentrations deposited in the exposure chamber compared with 3R4F CS exposure (Table 3).

Table 3 Smoke and aerosol exposure doses

Histology analysis on ALI epithelial cultures

Histological sections were obtained from cultures harvested 48 h PE, because morphological alterations would occur at later timepoints following exposure and after molecular changes took place (Castro et al. 2008). The processing of the organotypic cultures was conducted following previously published protocols (Iskandar et al. 2018; Zanetti et al. 2018).

Adenylate kinase release assay

Adenylate kinase activity in the basolateral medium of the cultures was measured from different cultures at 48 h PE using ToxiLight™ bioassay kit (Lonza, Basel, Switzerland), according to the manufacturer’s instructions. A luminescence signal was measured using a FLUOStar Omega reader (BMG LABTECH GmbH, Ortenberg, Germany). For each of the three experimental repetitions/phases (i.e., each culture batch), the values of the luminescence signal were normalized to the mean value of the positive (Triton X-100-treated cultures) and negative (untreated) control samples as previously described (Iskandar et al. 2018). The mean values (from a total of 9 independent exposure experiments) of the normalized relative luminescence units were then reported in figures as percentages.

Measurement of secreted inflammatory mediators from ALI epithelial cultures

MAP of inflammatory mediators secreted into the basolateral medium of cultures was performed using commercially available Milliplex panels (Merck Millipore, Burlington, MA, USA) with Luminex® xMAP® Technology (Luminex, Austin, TX, USA)-based analysis, according to the manufacturer’s instructions and following previously published protocols (Iskandar et al. 2018; Zanetti et al. 2018). The samples were randomized prior to the analysis. The data were log-transformed, and the geometric means were used to calculate the fold changes (FC) of the mediators (exposed vs. air-exposed samples), N = 9 independent exposure experiments. A more detailed description is provided in the Supplementary Materials and Methods.

Targeted proteomics by PRM

Targeted proteomics by PRM was conducted at the 24 h PE time for the ALI buccal epithelial cultures (N = 9 independent exposure experiments), and at the 48 h PE time for the ALI small airway epithelial cultures (N = 9 independent exposure experiments) following a previous published protocol (Iskandar et al. 2017). The timepoint collection for each culture type was decided based on the previous studies in which we detected greater changes in the protein levels following exposure (data not shown). Samples were randomized prior to the analysis. A more detailed description is provided in the Supplementary Materials and Methods.

Raw files from the PRM acquisition were analyzed with SpectroDive (version 8.0 Biognosys AG). Ion chromatograms for the endogenous peptides and the corresponding stable isotope-labeled reference peptides were extracted for all measured transitions [the list of transitions was reported in a previous publication (Iskandar et al. 2017)] using the software vendor’s default settings. For quantification, the area under the curve (AUC) intensities of all transitions were summed, and ratios of AUC sums of the endogenous and corresponding reference peptide signal were calculated.

For the statistical analysis, a linear model was fitted for each exposure and the respective sham group, including the experimental repetition as a covariate to account for the pairing between exposure and sham groups (Smyth 2004). The obtained raw p values (without empirical Bayes moderation, corresponding to a paired t test), were adjusted across protein markers using the Benjamini–Hochberg false discovery rate (FDR) method. Differentially expressed proteins were defined as those with an FDR-adjusted p value < 0.05.

RNA isolation and array analyses from ALI epithelial cultures

Total RNA, including miRNA, was isolated from the epithelial cultures (N = 9 independent exposure experiments) using a previously published method (Iskandar et al. 2018; Zanetti et al. 2018). Samples were randomized before processing. A more detailed description is provided in the Supplementary Materials and Methods.

Analysis of mRNA and miRNA data

The raw CEL files were background-corrected, normalized, and summarized using frozen robust multiarray analysis (McCall et al. 2010). Background correction and quantile normalization were used to generate microarray expression values from all arrays passing quality controls and were performed using the custom chip definition files environment HGU133Plus2_Hs_ENTREZG v16.0 (Dai et al. 2005), as previously described in greater detail (Iskandar et al. 2018; Zanetti et al. 2018).

A model was fitted using limma software (Smyth 2004) to estimate the treatment effect (for each experimental factor combination item, concentration, and PE duration) by including the covariate exposure run as a blocking variable to account for the pairing during an exposure run (exposed vs. air-exposed control samples). The p values for each computed effect were adjusted across genes using the Benjamini–Hochberg FDR method (Benjamini and Hochberg 1995). Differentially expressed genes were defined as a set of genes, whose FDR was < 0.05.

Causal network-based enrichment analysis of transcriptomic data

Quantitative assessment of the transcriptomic data was conducted using a network enrichment approach and the network perturbation amplitude (NPA) algorithm (Martin et al. 2014). Briefly, the methodology aims to contextualize transcriptome profiles (treated vs. control samples) and quantify the biological impact of exposure by combining alterations in gene expression into differential network node values (i.e., 1 value for each node of a causal network model) (Boué et al. 2015). The causal network models themselves are built while considering the biology relevant for the tissue and context under the study (Boué et al. 2015). For example, the network models used here are those relevant to respiratory physiology (see Supplementary Table 2). This contextual information is typically not available from most existing knowledge bases (Khatri et al. 2012); therefore, their use would improve the specificity and sensitivity to infer the exposure impacts. The network models used for the analysis are given in Supplementary Table 2.

The NPA method uses transcriptome data without an FC or p value cutoff. The differential node values were determined by fitting procedures inferring the values that best satisfy the directionality of the causal relationships contained in the network model (e.g., positive or negative signs). NPA scores carried a confidence interval accounting for experimental variation, and the associated p values were computed. In addition, companion statistics were derived to permute the network structure, and the gene expression profiles were derived to inform the specificity of the NPA score to the biology reflected in the network models. The results from those permutation statistics were reported as *O and K* if their p values fell below the threshold of significance (0.05). A network was considered significantly perturbed by exposure if the 3 values (the p value for experimental variation, *O, and K*) were below 0.05 (Martin et al. 2014).

A system-wide metric for biological impact, the Biological Impact Factor (BIF) (Hoeng et al. 2012; Thomson et al. 2013) summarized the impacts of the exposure on the cellular system into a single (absolute) number, thus enabling a simple and high-level evaluation of the treatment effects across multiple timepoints. Calculating the BIF required the collection of all applicable network models (Supplementary Table 2) and involved aggregating the NPA score of each network.

Statistical analyses and data repository

Basic descriptive statistical measures, such as mean, median, and standard deviation (SD), for all of the investigated endpoints were computed (except for the analysis of mRNA and miRNA, see “Analysis of mRNA and miRNA data” section; and for the analysis of targeted proteomics, see “Target proteomics by PRM” section). 3R4F CS-, MESH Classic Tobacco aerosol-, or Base aerosol-exposed groups were compared with the air-exposed controls using paired t test (paired within the same exposure chamber; the statistical comparisons focused on the differences between 3R4F CS-, MESH Classic Tobacco aerosol-, or Base aerosol-exposed groups vs. their own corresponding air-exposed controls that were exposed in the same exposure chamber). The analyses were performed in R-3.2.2 or R-3.1.2. Data set, further detail on the protocols, and additional data visualizations are available on the INTERVALS platform at https://doi.org/10.26126/intervals.ri2tah.1 [2D NHBE and 3D small airway studies] and https://doi.org/10.26126/intervals.kv8zst.1 [3D buccal study]). The mRNA array datasets can be accessed in the Arrays Express repository (ID: E-MTAB-7911). The miRNA array datasets can be accessed in the Arrays Express repository (ID: E-MTAB-7912).

Results

First-layer assessment: effects of MESH Classic Tobacco and Base liquids, compared with those of 3R4F CS TPM, on cell viability of 2D NHBE cells

The first layer of the proposed framework aims to screen e-liquids for their potential toxicity. In this context, we evaluated the impact of MESH Classic Tobacco liquid and Base e-liquids compared with that of 3R4F CS TPM on cell viability.

The viability of 2D NHBE cells was measured following a 24-h incubation with MESH Classic Tobacco e-liquid and its Base e-liquid, as well as 3R4F CS TPM, at different concentrations, using RTCA. RTCA measures electron flow transmitted between microelectrodes covering the bottom area of each well, where submerged cultures are seeded. Adhering cells disrupt the interaction between the electrodes, thus impeding the electron flow. This impedance—resistance to the altering electrical current—thus corresponds to the cell number, cell morphology/size, and the strength of the cell–cell attachment onto the plate (Yan et al. 2018).

Figure 2a shows a dose-dependent decrease in cell viability following a 24-h incubation with MESH Classic Tobacco e-liquid and its Base liquid (with a half maximal effective concentration [EC50] of 476.7 µg nicotine/mL for MESH Classic Tobacco and 423.6 µg nicotine/mL for Base e-liquid). The results showed that the effects on cell viability were similar between the 2 e-liquids with reference to their nicotine concentrations. Furthermore, decreased cell viability was detected following a 24-h incubation with 3R4F CS TPM at approximately 20-fold lower nicotine concentrations (with an EC50 of 19.3 µg nicotine/mL).

Fig. 2
figure 2

Cell viability in 2D NHBE cells and mechanistic investigation by HCS. a Cell viability in 2D NHBE cells incubated for 24 h with 3R4F CS TPM, MESH Classic Tobacco e-liquid, and Base e-liquid. Values are shown as the mean ± standard error of the mean (SEM). b Output of HCS endpoints from 2D NHBE cells incubated with 3R4F CS TPM, MESH Classic Tobacco e-liquid, and Base e-liquid for 4 and 24 h (N = 3–8 independent experiments). For each HCS assay, the FCs of the response refer to the ratio of the signal detected following incubation with 3R4F CS TPM, MESH Classic Tobacco e-liquid, and Base e-liquid relative to the signal detected following incubation with the culture medium only. c Average MEC (from replicates of the independent experiments) for 3R4F CS TPM, MESH Classic Tobacco e-liquid, and Base e-liquid for each of the tested assays

Second-layer assessment: effects of MESH Classic Tobacco and Base liquids, compared with those of 3R4F CS TPM, determined using HCS assays and 2D NHBE cells

The second layer of the proposed framework aims to identify the toxicity-related mechanisms beyond the impact on cell viability. For this, we utilized HCS assays that rely on the use of simultaneous recording of multiple fluorescence readouts coupled with image processing and visualization tools to extract quantitative data (Xia and Wong 2012). A specific endpoint is detected using a specifically designed fluorogenic antibody/dye.

We incubated 2D NHBE cells for 4 and 24 h with the MESH Classic Tobacco e-liquid and its Base e-liquid, as well as with 3R4F CS TPM at different concentrations. Figure 2b shows that a 4-h incubation with 3R4F CS TPM resulted in dose-dependent impact on DNA damage, glutathione content, oxidative stress, and stress kinase (c-Jun). More pronounced changes were seen for 3R4F CS TPM when the cells were incubated for 24 h. Changes of these markers after incubation with MESH Classic Tobacco e-liquid or Base e-liquid were also detected, but at much higher nicotine concentrations, and the duration of the incubation did not largely influence the culture’s response.

Moreover, to facilitate a better comparison across the tested items, we derived the MEC for each tested endpoint and for each tested item. The MEC indicates the dose of the test item at which we detected a response above the noise level (see Materials and Methods). Figure 2c shows the MECs at which 3R4F CS TPM, MESH Classic Tobacco e-liquid, and Base e-liquid elicited a response in 2D NHBE cells after they were incubated for 4 and 24 h. The numbers at the outer pie chart correspond to the nicotine concentrations associated with the MECs; if the response (for all doses tested) was constant, we did not derive the MEC. The lower the MEC, the longer the arc length of 1 pie slice (i.e., 1 HCS assay endpoint). Therefore, the arc length of the pie slice indicates the effect (potential toxicity) of each item tested. The results show that the arc lengths associated with 3R4F CS TPM were greater than those associated with MESH Classic Tobacco e-liquid and its Base e-liquid. Impacts in cell membrane permeability and cytochrome c release were not detected following the 4-h incubation with 3R4F CS TPM, but were detected following the 24-h incubation; this reflects the dose–response curves in Fig. 2b. The impacts of MESH Classic Tobacco and Base e-liquids were similar, with shorter arc length than those of the 3R4F CS TPM.

We list the calculated MEC—which is the minimum concentration at which we could detect effects—in Table 4. The results indicated that to reach an effect elicited by a 24-h incubation with 3R4F CS TPM, we needed to incubate 2D NHBE cells in MESH Classic Tobacco e-liquid at a concentration of ~ 51 times greater than the concentration of 3R4F CS TPM (622.83 divided by 12.09; see Table 4). Similarly, a ~ 52-fold higher concentration of Base e-liquid was needed to trigger cellular responses that were detected following the 24-h incubation with 3R4F CS TPM (630.17 divided by 12.09; see Table 4).

Table 4 Comparison of MECs

Third-layer assessment: biological impacts of exposure to the whole aerosol of MESH Classic Tobacco compared with those of 3R4F CS using 3D ALI human buccal and small airway epithelial models

The third layer of the proposed framework focuses on the investigation of the toxicity-related mechanism of EC aerosols, not e-liquids. For this, we conducted exposure experiments using ALI human organotypic buccal and small airway epithelial culture models. To fairly compare the effect of exposures (among MESH Classic Tobacco aerosol, Base aerosol, and 3R4F CS), the doses of MESH Classic Tobacco aerosol and Base aerosol applied to the cultures are those that resulted in at least similar or higher nicotine deposition (in the exposure chamber) than 3R4F CS (see Materials and Methods, Table 3).

Cytotoxicity was first evaluated by quantifying the activity of adenylate kinase released into the basolateral media of buccal (Fig. 3a) and small airway (Fig. 3b) cultures 48 h following exposure. For both culture types, we found that cytotoxicity in the cultures following exposure to the undiluted MESH Classic Tobacco or Base aerosols at the puff number tested were comparable with those exposed to air. In contrast, cytotoxicity levels in cultures exposed to the diluted 3R4F CS, at doses resulting in a lower deposited nicotine concentration than MESH Classic Tobacco or Base aerosols, were around 30% cytotoxicity.

Fig. 3
figure 3

Cytotoxicity in human buccal and small airway epithelial cultures following exposure. Relative cytotoxicity is shown as mean ± SEM (N = 9 per group) for a buccal and b small airway cultures (*p value ≤ 0.05 compared with air-exposed controls). The relative cytotoxicity was determined based on the release of adenylate kinase from the epithelial cultures to the basolateral media at 48 h PE (Triton X-treated cultures were considered to have 100% cytotoxicity, and non-exposed [incubator control] cultures were considered to have 0% cytotoxicity). NA not applicable, Nic nicotine

Pronounced histological alterations were not seen in either buccal or small airway cultures 48 h following exposure to the undiluted MESH Classic Tobacco or Base aerosols, which resulted in nicotine concentrations up to around 159 µg/mL (for buccal) and 54 µg/mL (for small airway) (Fig. 4a, b). The morphology of the culture sections was similar to that of the air-exposed controls. Differently, buccal cultures that were exposed to 69% 3R4F CS for 112 puffs, which resulted in a deposited nicotine of around 92 µg/mL, had marked cell alterations, apoptosis, dyskeratosis, and increased superficial desquamation. In small airway cultures, we detected marked increases in apoptosis and epithelial atrophy following exposure to only 13% 3R4F CS for 112 puffs, which resulted in a deposited nicotine of only around 10 µg/mL.

Fig. 4
figure 4

Histology of human buccal and small airway epithelial cultures. a Representative images of the hematoxylin and eosin-stained buccal culture sections and b hematoxylin, eosin, and Alcian blue-stained small airway culture sections are shown. The cultures were collected 48 h following exposure to the air, 3R4F CS, MESH Classic Tobacco aerosol, or Base aerosol for various doses as indicated. The concentrations of nicotine deposited in PBS in the exposure chamber are indicated in µg/mL

To investigate the molecular impact of exposure to MESH Classic Tobacco aerosol, we performed a mechanistic assessment using 2 approaches: (1) a causal network enrichment analysis based on the transcriptome profiles and (2) a targeted protein analysis of the secreted inflammatory mediator and selected markers in epithelial cells. For this mechanistic investigation, we excluded samples that already exhibited marked damage (i.e., the buccal cultures exposed to 69% 3R4F CS for 112 puffs and small airway cultures exposed to 13% 3R4F CS for 112 puffs, see Fig. 4a, b). This is because cellular and molecular changes in an already damaged tissue would merely reflect these morphological alterations (Davis et al. 2013; Janovitz and Wallig 2013). Furthermore, for comparison purposes, we focused on examining the cultures that were exposed to the undiluted MESH Classic Tobacco or Base aerosols for the same puff number (i.e., 112 puffs).

The first approach for the mechanistic investigation, the causal network enrichment analysis, uses transcriptome data and the p value threshold-free NPA algorithm (Martin et al. 2014). The NPA method computes exposure-induced perturbation scores of various biological processes using the sample transcriptome profiles to contextualize the exposure effect by deriving the alterations in transcriptomes into differential node values of causal networks (Fig. 5a); a more detailed description of the approach was reported previously (Hoeng et al. 2014). The network models can be further summarized into 4 main cellular processes (Cell Fate, Cell Proliferation, Cell Stress, and Inflammatory Process Network families), and ultimately, an overall perturbation score, which is termed the BIF, can be computed.

Fig. 5
figure 5

Causal network enrichment analysis on the transcriptome profiles. a From the global gene expression changes between exposed and air-exposed control samples, we used a collection of toxicological causal biological network models to deduce the biological impact of an exposure on a given network using the NPA algorithm (see Materials and Methods). Thus, the overall impact, termed BIF, can be deduced. The BIF takes into account the overall perturbations of all networks analyzed. Perturbations of the network families 4, 24, and 48 h following exposure to the 3R4F CS or EC aerosols for 112 puffs in b buccal and c small airway cultures are shown as pie charts. For a given culture type, the contrast with the highest perturbation is marked with a thick black line (taken as 100% BIF, or the reference “REF”). The overall BIF for the corresponding PE timepoints is shown in d and e, respectively

In this study, we generated the transcriptome data from the buccal and small airway epithelial cultures collected 4, 24, and 48 h following exposure. From the transcriptome data, we derived the perturbation of each network model analyzed (the perturbations of each network are given in Supplementary Fig. 2). Figure 5b, c shows that at any PE timepoint analyzed, perturbations of Cell Fate, Cell Proliferation, Cell Stress, and Inflammatory Process Network families following exposure to undiluted MESH Classic Tobacco or Base aerosols for 112 puffs were generally lower than the perturbation following 3R4F CS. An exception was seen in buccal cultures for Inflammatory Process Network family at the 4 and 24 h PE timepoints, i.e., the perturbation following Base aerosol was greater than following 3R4F CS (Fig. 5b). Note that the concentrations of deposited nicotine following MESH Classic Tobacco or Base aerosols were higher than those following 3R4F CS.

We further calculated the overall impact—a term we refer to as the “BIF”—in buccal (Fig. 5d) and small airway (Fig. 5e) cultures. The highest BIF score was taken as 100% and assigned to the reference group (termed “REF” in Fig. 5d, e). At any given timepoint analyzed, the highest BIF score for buccal cultures was seen for 3R4F CS, followed by Base aerosol and finally MESH Classic Tobacco aerosol. For small airway cultures, the highest BIF score was also detected for 3R4F CS, followed by similar BIF values (lower than the BIF for 3R4F CS) for both MESH Classic Tobacco and Base aerosols. The BIF scores in buccal cultures also show that the impact of exposure to MESH Classic Tobacco or Base aerosols dissipated after 48 h. However, in small airway cultures, the impact had already diminished after 24 h.

Interestingly, analyses of the global changes in the miRNAs showed that none of the miRNAs were significantly altered following exposure to MESH Classic Tobacco or Base aerosols in both buccal and small airway cultures (with the exception of 1 miRNA—miR-320b—that was found differentially increased only at the 24 h PE timepoint following Base aerosol exposure in small airway cultures). In contrast, significant alterations in many miRNAs were detected following exposure to 3R4F CS (Supplementary Fig. 3).

For the second approach of the mechanistic investigation, we quantified markers of proteins in the epithelial culture samples using PRM, a targeted mass spectrometry (MS)-based approach. The evaluated markers included proteins that are linked to relevant processes, such as xenobiotic metabolism response, oxidative stress, and autophagy. In both buccal and small airway epithelial cultures, exposure to the undiluted MESH Classic Tobacco or Base aerosols for 112 puffs was not linked to any marked alterations in the abundance of these proteins. Exposure to the already diluted 3R4F CS for 112 puffs was linked to significant increase in the abundance of cytochrome P450 (CYP) 1A1 and CYP1B1 proteins (around 60-fold) relative to the abundance of the proteins following air exposure (Fig. 6a). ALDH1A3 protein abundance was also increased in cultures exposed to 3R4F CS exposure, although to a lesser degree than CYP enzymes. In buccal cultures, GCLC and NQO1 (oxidative stress markers), SQSTM1 (autophagy marker), and ALDH3A1 protein abundances were also altered following exposure to 3R4F CS. We measured other protein markers; however, they were not significantly altered following any of the exposure conditions tested (Supplementary Fig. 4).

Fig. 6
figure 6

Alterations in protein markers following 3R4F CS and EC aerosol exposure. a Set of proteins was quantified using targeted MS-based proteomics for the buccal epithelial cultures collected 24 h following exposure and small airway epithelial cultures collected 48 h following exposure. Each row represents 1 quantified protein, and each column represents a comparison between an exposed sample and air-exposed controls. b Set of mediators regulating inflammatory response was quantified using Luminex-based multiplex assay from the basolateral medium of the cultures collected 48 h following exposure. Star symbol (*) indicates p value ≤ 0.05 compared with the air-exposed samples

Furthermore, because the network analysis suggested that inflammatory response was elicited following exposure to MESH Classic Tobacco aerosol, we gathered additional information by analyzing the profile of secreted inflammatory mediators from the epithelial cultures using MAP analysis. We collected the basolateral media 48 h PE and measured the concentrations of various mediators involved in inflammatory response.

Figure 6b shows the concentrations of the mediators that were altered 48 h following exposure to MESH Classic Tobacco aerosol, Base aerosol, 3R4F CS, or air. In both buccal and small airway cultures, increased matrix metalloproteinase (MMP)-1 and decreased chemokine (C–X–C motif) ligand (CXCL) 10 (also known as IP-10) concentrations were detected following exposure to 3R4F CS. In contrast, their concentrations were not altered in the basolateral media of cultures exposed to MESH Classic Tobacco or Base aerosols. For other mediators, they were altered depending on the exposure and culture types. In buccal cultures, decreased concentrations of CXCL 1 (also known as GRO α) and increased concentrations of interleukin (IL)-1β were detected following 3R4F CS exposure; however, they were not significantly altered following exposure to MESH Classic Tobacco or Base aerosols. In turn, IL-1α concentrations were found to be greater in the media of buccal cultures exposed to MESH Classic Tobacco or Base aerosols, but only slightly increased in the media of cultures exposed to 3R4F CS. In small airway cultures, increased vascular endothelial growth factor A (VEGFA), IL-8, and tissue inhibitor of metalloproteinase (TIMP)-1 secretion levels were found in cultures exposed to 3R4F CS, but not in the media of cultures exposed to MESH Classic Tobacco or Base aerosols.

Other mediators (e.g., IL-1α and IL-1β in small airway cultures and VEGFA, IL-8, and TIMP-1 in buccal cultures) were also measured; however, their levels, including in the air-exposed cultures, were around and/or below the limit of the quantification (LOQ) (data not shown).

Discussion

The challenges for testing the potential toxicity of EC aerosols come not only from the apparent increased availability of EC devices, but also from the numerous flavors in the e-liquids. A robust approach is thus needed to test the potential toxicity of the final EC liquids and, eventually, the aerosolized formulations. Previously, we proposed a three-layer system toxicology framework for testing e-liquids (Iskandar et al. 2016). It starts with assessing the effects of e-liquids on cell viability (first layer), followed by investigating the potential mechanisms of toxicity elicited by e-liquids (second layer) and finally assessing the impacts of aerosols (third layer) (Iskandar et al. 2016). In the present work, we showed how we leveraged the three-layer framework to evaluate the potential toxicity and biological effects of the MESH Classic Tobacco and Base e-liquids/aerosols compared with those of 3R4F CS.

The results from the first-layer assessment suggested that the addition of MESH Classic Tobacco flavor mix is unlikely to alter the cytotoxicity of its Base e-liquid. We found that the EC50 value of 2D NHBE cells following incubation with MESH Classic Tobacco was similar to those following incubation with Base e-liquids. They were approximately 23-fold higher than those following incubation with 3R4F CS TPM with reference to their nicotine concentrations. Our observation, however, was different from that reported earlier (Stevenson et al. 2019), showing that the addition of flavors (of other brands) increased the cytotoxicity of the base e-liquids when measured using the human myeloid leukemia-derived cell line. We noted that in that study, the commercial e-liquids were not directly compared with each corresponding base e-liquid (i.e., the commercial formulations were merely tested along with other formulations that do not contain flavors, regardless of whether the concentrations of PG, VG, or nicotine were similar). In addition, the e-liquids tested and the cell model used in that study were also different from what we used here. These aspects could likely explain the discrepancy between the results reported here and those in the earlier study (Stevenson et al. 2019).

Furthermore, to investigate whether the increased cytotoxicity was influenced by hyperosmolarity, which was reported previously for PG and G (Chaumont et al. 2019; Gonzalez-Suarez et al. 2017), we measured the osmolarity of the e-liquids. We found that the increased cytotoxicity associated with MESH Classic Tobacco and Base e-liquids was directly correlated with the osmolarity (Supplementary Fig. 5). This finding suggested that osmolarity could be a confounding factor in toxicity measures for e-liquids, an observation we previously highlighted in the context of the multi-layer framework (Iskandar et al. 2016). Osmolarity of the e-liquids should thus be evaluated in every study, where e-liquid toxicity is investigated.

The HCS assay results from the second-layer assessment were complimentary to those obtained from the first-layer assessment. No major differences in cell membrane permeability, cytochrome c release, DNA damage, GSH content, oxidative stress, and stress kinase were detected between cultures incubated with MESH Classic Tobacco e-liquid and with Base e-liquid. This observation supported the premise that the addition of flavors (in the MESH Classic Tobacco e-liquid) is unlikely to elicit molecular changes distinct from those elicited following treatment with the Base e-liquid only. The HCS assay results also showed that various biological processes were markedly impacted following incubation with 3R4F CS TPM, even though they were administered to the cultures at much lower nicotine concentrations than MESH Classic Tobacco e-liquid or its Base e-liquid (the highest concentrations of MESH Classic Tobacco or Base e-liquids tested contained 23 times higher nicotine than the highest tested concentration of 3R4F CS TPM). This finding suggested that the potential toxicity of MESH Classic Tobacco or Base e-liquids to 2D NHBE cells was much lower than the toxicity of 3R4F CS TPM when compared based on their nicotine levels.

Evaluating the e-liquids can still provide insights into their potential toxicity; however, we also recognize that in reality, the human respiratory system will be exposed to the aerosol and not to the e-liquid. Certain chemicals, despite being approved for ingestion, have been shown to elicit adverse effects when inhaled (e.g., diacetyl, acetylpropionyl, acetoin, cinnamaldehyde, and benzaldehyde) (NAS 2018). Although some may rely on the “Generally Recognized as Safe” (GRAS) status to justify the use of certain flavors in e-liquid formulations, the GRAS status only signifies that the flavors are safe for oral administration and use in food products, but does not prove that the flavors are safe for inhalation (NAS 2018). Therefore, in the third layer of the assessment framework, we tested the biological impacts of exposure to MESH Classic Tobacco and Base aerosols.

The aerosolization process might yield other products originated from the thermal decomposition of the flavors that occurs at high temperatures (Czégény et al. 2016; Wang et al. 2017). Therefore, we also measured the concentrations of various carbonyls that were deposited into PBS that was placed into the base module of the exposure chambers. From this experiment, following exposure to undiluted MESH Classic Tobacco or Base aerosols for 480 puffs, the concentrations of carbonyls—formaldehyde, acetaldehyde, acetone, acrolein, propionaldehyde, crotonaldehyde, methyl ethyl ketone, and butyraldehyde—were below the LOQ (Supplementary Table 3). This is in contrast to what can be detected following exposure to 3R4F CS: the levels of carbonyls reached to up to 40-fold the lower limit of quantification (LLOQ) (Supplementary Table 3).

The results of the third-layer assessment showed that exposure to MESH Classic Tobacco or Base aerosols, which resulted in concentrations of deposited nicotine up to 54 µg/mL, did not cause cytotoxicity and tissue damage to small airway cultures, while the diluted 3R4F CS, which resulted in a concentration of deposited nicotine of 10 µg/mL, was cytotoxic and caused tissue damage in small airway cultures. In buccal epithelial cultures, MESH Classic Tobacco or Base aerosols at a dose resulting in concentrations of deposited nicotine up to 159 µg/mL were non-toxic, while the diluted 3R4F CS that resulted in a concentration of deposited nicotine around 92 µg/mL caused marked cytotoxicity and tissue damage. Compared with the concentrations of nicotine found in the saliva of EC users (Papaseit et al. 2017), these concentrations were already overestimations of the human exposure: Papaseit and colleagues reported that the maximum nicotine concentrations in the saliva of EC users after 2 consecutive sessions (with 10 puffs per session) were only around 0.86 µg/mL (Papaseit et al. 2017).

Based on the global gene expression profiles, among the 4 network families tested, exposure to the undiluted MESH Classic Tobacco or Base aerosols had a more pronounced impact mainly on the Inflammatory Process Network family. Nonetheless, at the 48 h post-exposure timepoint, the perturbations of Inflammatory Process Network family following exposure to undiluted MESH Classic Tobacco or Base aerosols were less than the perturbation following diluted 3R4F CS exposure in both buccal and small airway cultures. These results suggested that there was an early inflammatory response triggered following exposure to MESH Classic Tobacco or Base aerosols; however, the cultures could finally recover.

Interestingly, for buccal cultures, exposure to Base aerosol resulted in slightly higher overall perturbations (up to ~ 40% relative BIF) than exposure to MESH Classic Tobacco aerosol (up to ~ 20% relative BIF). This slightly higher relative BIF scores of Base aerosol compared with MESH Classic Tobacco aerosol in the buccal cultures, however, was not corroborated by the other endpoints measured in this study, such as cytotoxicity, histology, selected protein markers, concentrations of secreted mediators, and miRNA profile. This leads us to think that the slightly greater overall perturbations had little implication in the physiological processes of buccal cultures.

Such a tissue-specific response was also reflected from the profiles of secreted mediators that were altered following exposure. Tissue-specific soluble factors are important to condition the local environment against stimuli or pathogens (Hu and Pasare 2013). Decreased GRO and increased IL-1β secretion following 3R4F CS exposure were only detected in buccal cultures but not in small airway cultures, while marked increased secretion in VEGFA, IL-8, and TIMP-1 following 3R4F CS exposure was seen only in small airway cultures but not in buccal cultures; these observations were consistent with our previous finding (Iskandar et al. 2019). These mediators were not altered pronouncedly following exposure to MESH Classic Tobacco or Base aerosols.

Nonetheless, we were intrigued by the pronounced increase in IL-1α secretion from buccal cultures following exposure to MESH Classic Tobacco or Base aerosols, despite the absence of tissue damage. This observation was also seen previously in buccal cultures following exposure to an EC aerosol of a prototype “Test Mix” and its base formulation (Iskandar et al. 2019). The expression of the IL1A gene, however, was not markedly impacted by MESH Classic Tobacco and Base aerosol exposure (data not shown). The absence of cytotoxicity and tissue damage in these cultures prompted us to assume that the increase IL-1α secretion could be a stress response specific for stratified keratinized epithelium (i.e., buccal epithelium) triggered by a highly exaggerated exposure concentration (as discussed earlier, the EC aerosol nicotine concentrations tested were around 60 times higher than human saliva concentrations following EC use [~ 53 µg nicotine/mL in this in vitro study vs. ~ 0.86 µg nicotine/mL in human samples (Papaseit et al. 2017)]. This would be aligned with an earlier premise that IL-1α secretion from cells that maintain their integrity may be a stress-sensing mechanism demonstrating cellular stress resolution and recovery (Kim et al. 2013; Rider et al. 2017). IL-1α is also found constitutively present in keratinocytes, epithelial cells, and endothelial cells under normal conditions, unlike IL-1β, which mainly elevated under pathological conditions (Dinarello 2018). Future studies should aim for a more comprehensive assessment of the role of IL-1α in buccal epithelium following exposure to EC.

One of the limitations of the study is attributed to the lack of data on submerged oral epithelial cells using the first- and second-layer assessment, even though we tested the impact of the smoke/aerosols on the 3D ALI buccal epithelial cultures. The correlation between data obtained using these two systems (submerged 2D vs. ALI 3D cultures) could be useful to estimate the potential toxicity of certain e-liquid formulations, as in an initial screening approach. For example, in the present study, the first-layer assessment showed that 3R4F CS TPM containing 10 µg nicotine/mL resulted in a 30% reduction in cytotoxicity of submerged primary bronchial epithelial cells (based on RTCA), while the third-layer assessment showed that 3R4F CS at a dose resulting in around 10 µg deposited nicotine/well also resulted in around 30% cytotoxicity in ALI small airway cultures (based on AK assay). Therefore, this observation suggested that the information obtained in the first- and second-layer assessment may still provide a relevant indication to the potential toxicity of the aerosolized formulations.

A standardization in EC-testing approaches is lacking (Iskandar et al. 2016). For example, standardized puffing regimens for CS are available from various entities such as the Federal Trade Commission, International Organization for Standardization, Cooperation Centre for Scientific Research Relative to Tobacco (CORESTA), and Health Canada. In contrast, a standardized puffing regimen for ECs does not exist, except one that is proposed by CORESTA (i.e., the CORESTA Recommended Method No. 81, (CORESTA 2015)). Furthermore, a standardized battery of assays for in vitro toxicity testing of ECs and a standard reference EC are also not available. These issues have challenged a proper comparison across studies conducted in different laboratories. A joined force across sectors (regulatory authorities, industry, and academia) is needed to collaboratively define a robust study design with appropriate sample size and statistical analysis that meets the regulatory requirement for toxicity studies of ECs.

In conclusion, the present work showcased how the multi-layer systems toxicology framework can be applied to assess the potential toxicity of an EC liquid formulation and its aerosol. In the first-layer assessment, we determined that the toxicity of MESH Classic Tobacco and Base e-liquids was similar, and was much less than that of the TPM fraction from 3R4F CS. In the second-layer assessment, distinct molecular changes were not detected following exposure to MESH Classic Tobacco e-liquid compared with Base e-liquid treatment, as determined using HCS assays, while substantial effects were elicited by 3R4F CS TPM at much lower nicotine concentrations. Finally, in the third-layer assessment, we found that the impact of exposure to aerosol of the MESH Classic Tobacco or Base was markedly lower than that of exposure to 3R4F CS. This work demonstrated that the multi-layer systems toxicology framework could be useful to assess in vitro the potential-reduced impact of EC relative to 3R4F cigarettes in a comprehensive manner and is a very insightful strategy to acquire preliminary data that would be relevant to support potential clinical outcomes.