Calcium plus vitamin D supplementation and risk of fractures: an updated meta-analysis from the National Osteoporosis Foundation
verfasst von:
C. M. Weaver, D. D. Alexander, C. J. Boushey, B. Dawson-Hughes, J. M. Lappe, M. S. LeBoff, S. Liu, A. C. Looker, T. C. Wallace, D. D. Wang
The aim was to meta-analyze randomized controlled trials of calcium plus vitamin D supplementation and fracture prevention. Meta-analysis showed a significant 15 % reduced risk of total fractures (summary relative risk estimate [SRRE], 0.85; 95 % confidence interval [CI], 0.73–0.98) and a 30 % reduced risk of hip fractures (SRRE, 0.70; 95 % CI, 0.56–0.87).
Introduction
Calcium plus vitamin D supplementation has been widely recommended to prevent osteoporosis and subsequent fractures; however, considerable controversy exists regarding the association of such supplementation and fracture risk. The aim was to conduct a meta-analysis of randomized controlled trials [RCTs] of calcium plus vitamin D supplementation and fracture prevention in adults.
Methods
A PubMed literature search was conducted for the period from July 1, 2011 through July 31, 2015. RCTs reporting the effect of calcium plus vitamin D supplementation on fracture incidence were selected from English-language studies. Qualitative and quantitative information was extracted; random-effects meta-analyses were conducted to generate summary relative risk estimates (SRREs) for total and hip fractures. Statistical heterogeneity was assessed using Cochran’s Q test and the I2 statistic, and potential for publication bias was assessed.
Results
Of the citations retrieved, eight studies including 30,970 participants met criteria for inclusion in the primary analysis, reporting 195 hip fractures and 2231 total fractures. Meta-analysis of all studies showed that calcium plus vitamin D supplementation produced a statistically significant 15 % reduced risk of total fractures (SRRE, 0.85; 95 % confidence interval [CI], 0.73–0.98) and a 30 % reduced risk of hip fractures (SRRE, 0.70; 95 % CI, 0.56–0.87). Numerous sensitivity and subgroup analyses produced similar summary associations. A limitation is that this study utilized data from subgroup analysis of the Women’s Health Initiative.
Conclusions
This meta-analysis of RCTs supports the use of calcium plus vitamin D supplements as an intervention for fracture risk reduction in both community-dwelling and institutionalized middle-aged to older adults.
The risk of osteoporotic fractures increases with age among individuals aged >50 years [1, 2]. Although many factors contribute to this debilitating event, the most significant causes are reduction in bone mass, structural deterioration, and increased frequency of falls. Calcium plus vitamin D supplementation has been widely recommended for the prevention of osteoporosis and subsequent fractures; however, recent data have been inconsistent. Whereas some studies show that calcium plus vitamin D supplementation reduces the risk of fractures, others show no effect, and one study shows that supplementation may increase the risk. Concern has arisen recently that calcium supplementation may be harmful, so some individuals and healthcare providers are reluctant to use calcium supplements [3]. On the other hand, there is a growing interest in the role of vitamin D to support bone health, and healthcare providers are increasing their use of laboratory tests to assess vitamin D status among the population.
In 2007, the US Agency for Healthcare Research and Quality (AHRQ) University of Ottawa Evidence-based Practice Center (EPC) published an evidence synthesis on the effectiveness and safety of vitamin D in relation to bone health [4]. This synthesis suggested that there was fair evidence of an association between circulating 25-hydroxyvitamin D concentrations, the functional indicator of vitamin D status, with some bone health outcomes (e.g., bone mineral density); however, this evidence was inconsistent across populations including infants and children [4]. The AHRQ Tufts University EPC subsequently published two additional evidence-based reports on this topic. The first evidence report, published in 2009 [5], was conducted to support the development of dietary reference intakes for calcium and vitamin D from the Institute of Medicine [6]. The second evidence report, published in 2011 [7], was conducted to support recommendations from the US Preventive Services Task Force (USPSTF) for use of vitamin D (with or without calcium) for prevention of cancer and fractures [8]. The 2011 Tufts EPC evidence report [7] included a meta-analysis that was weighted heavily by a nonsignificant effect of calcium plus vitamin D in preventing hip fracture from the Women’s Health Initiative (WHI) due to its large sample size (36,282 postmenopausal women) [9]. Based on the findings from the 2011 Tufts EPC evidence report [7], as well as other evidence available at that time, the USPSTF recommended against daily supplementation with ≤400 IU vitamin D3 and ≤1000 mg calcium or supplemental vitamin D alone for the primary prevention of fractures in noninstitutionalized postmenopausal women [8]. However, additional data on the topic have now been published, including new information from the WHI that incorporated both adherence and personal use of supplements at baseline [10]. As a result, the National Osteoporosis Foundation convened an expert panel to provide an updated review of the evidence linking calcium plus vitamin D to fracture prevention that expands the data considered in the 2011 Tufts EPC evidence report [7] with these newer data.
Anzeige
Methods
Literature search and study inclusion
Two comprehensive literature searches were conducted. First, a PubMed and Medline literature search was conducted for the period from July 1, 2011 through July 31, 2015, to update the meta-analysis of randomized controlled trials (RCTs) presented in the Tufts EPC evidence report [7]. The following medical subject headings (MeSH) were used: vitamin D, calcium, bone fractures, accidental falls, bone density, and clinical trials. In addition, free-text terms and relevant variants for vitamin D, calcium, fractures, accidental falls, bone density, and clinical trials were used in the search. We included RCTs of generally healthy adults (<20 % of study participants had major chronic diseases such as diabetes or cardiovascular disease, at baseline) that compared vitamin D supplementation plus calcium against no supplementation or placebo. We excluded studies that enrolled pregnant women only or measured vitamin D status only during pregnancy and RCTs comparing different dosages of vitamin D supplementation without a control group that did not receive vitamin D supplementation. To include available data on elderly persons (aged ≥65 years), we also accepted RCTs of older ambulatory adults with any disease other than cancer. We excluded short-term (<1 month) RCTs and trials that used synthetic vitamin D analogs (for example, oxacalcitriol or paricalcitol). Fracture outcomes included total and hip fractures. All articles were screened by title, abstract, and, in some cases, full-text review. A complete manual search of reference lists of original studies was conducted. A total of 582 abstracts were identified that incorporated vitamin D plus calcium search strings (Fig. 1). This search identified the WHI analysis published by Prentice et al. [10] and the 2011 Tufts EPC evidence report [7], which supported the effectiveness of the literature search strategy. Based on the title and abstract review, 24 studies were considered potentially eligible and were retrieved for full-text screening [10‐33], plus 11 originally included studies from the Tufts EPC report [9, 34‐43]. Additionally, we identified a correction to the 2011 Tufts EPC evidence report, which was published in the October 2014 edition of the Annals of Internal Medicine [44]. This letter indicated that three originally included studies compared calcium plus vitamin D supplementation with a calcium supplement placebo. These three studies [37, 40, 41] along with one additional study [28] reviewed in the full-text screening were excluded since they did not compare calcium plus vitamin D supplementation with a placebo. Fourteen remaining studies were excluded since they did not directly evaluate the effect of calcium with combined vitamin D supplementation on fracture prevention [11, 14‐16, 18, 19, 21, 22, 25, 27, 30‐33]. Eight additional studies were excluded because of non-RCT study design [12, 20, 23], article not in English [24], hospitalized population [26], and repeated data sources from Women’s Health Initiative [13, 17, 29]. Thus, the study by Prentice et al. [10] was the only remaining study that met the specified inclusion criteria in the updated search.
Fig. 1
Flowchart for the selection of eligible studies
×
In addition to replicating and augmenting the 2011 Tufts EPC evidence report’s literature search [7] as described above, we conducted a second comprehensive search of all available literature without limits by year of publication. No additional studies were identified (2329 citations were identified after deduplication).
Data extraction
We extracted qualitative and quantitative information from each study, including author and year of study, geographic study location, name of the trial (if applicable), trial size, duration of follow-up, type of exposure, exposure metric units, analytical comparisons, number of fracture events, and relative risks (RRs) with 95 % confidence intervals (CIs). The 2011 Tufts EPC evidence report [7] calculated RRs based on the number of events and group size in each individual study. For our analyses, we extracted the calculated RR and CI data if available in the individual study, and we calculated RRs and CIs from event and group size data in the absence of reported RR estimates. By utilizing this methodology, we were able to obtain the most accurate RR based on multivariate statistical analyses. The largest source of data on this topic originates from the WHI calcium plus vitamin D supplementation clinical trial, for which 36,282 postmenopausal women were enrolled. In 2006, Jackson et al. [9] published an analysis of calcium plus vitamin D supplementation and the risk of fractures among participants in this trial. The results from this analysis were included in the 2011 Tufts EPC evidence report [7]. Since this publication, Prentice et al. [10] conducted an updated and more comprehensive post hoc analysis of the WHI clinical trial and published the results in 2013. The authors reported total and hip fracture risk estimates for calcium plus vitamin D supplementation in all participants, as well as those adherent participants who did not use self-selected “personal” (i.e., not provided by the study) calcium with or without combined vitamin D supplements at baseline. In addition, Prentice et al. [10] reported data at baseline as well as for the duration of supplementation throughout the study. Thus, data from the study by Prentice et al. [10] replaced data from the study by Jackson et al. [9] in a subanalysis presented herein (Table 1).
Table 1
Summary of meta-analysis results for calcium plus vitamin D supplementation versus placebo and fracture risk
CI confidence interval, ND no data, RR relative risk, WHI Women’s Health Initiative
aData analyzing the WHI for adherence to assigned pills and no personal use of supplements from Table 6 in Prentice et al. [10]
bData provided from WHI investigators
Statistical analyses
Random-effects models were used to calculate summary relative risk estimates (SRREs), 95 % CIs, and corresponding P values for heterogeneity. Meta-analysis models were generated to examine the RR of vitamin D plus calcium supplementation on total and hip fractures. Subgroup and sensitivity analyses were performed to examine summary effects based on certain study characteristics such as the use of personal supplements, adherence to assigned study pills (1000 mg calcium carbonate plus 400 IU vitamin D3 per day) in the WHI, and institutionalized versus community-dwelling individuals.
Anzeige
Prior to conducting new subanalyses, we replicated the meta-analysis presented in the published erratum [44], which used the previous WHI data from Jackson et al. [9]. After successful replication, we generated a subanalysis using the updated WHI data as reported by Prentice et al. [10]. Prentice et al. [10] report hazard ratios and 95 % CIs for total and hip fracture for all trial participants with and without personal supplement use (see Table 2 in Prentice et al. [10]), and for trial participants who adhered to their assigned study pills with and without personal supplement use (see Table 6 in Prentice et al. [10]). For our subanalysis, we used data among trial participants in the WHI who did not use personal supplements and who adhered to their assigned pills as our base case. We were not able to look at personal supplement use and adherence among other trials included in the meta-analysis, since these data are not currently available in the peer-reviewed literature. Sensitivity analyses were conducted for all combinations of data reported by Prentice et al. [10]. As indicated previously, our primary outcome analysis was the comparison of calcium plus vitamin D supplementation versus a placebo.
One-study-removed influence analyses were conducted to determine the relative influence (i.e., weight) of each study on the overall risk estimate. Statistical heterogeneity was assessed using Cochran’s Q test and the I2 statistic. The presence of publication bias was assessed visually by examining a funnel plot measuring the standard error as a function of effect size, as well as by performing Egger’s regression method and the Duval and Tweedie imputation method [45]. All statistical analyses were performed using Comprehensive Meta-Analysis software (version 2.2046; Biostat Inc., Englewood, NJ).
Results
We successfully reproduced the findings of Chung et al. [44] in regard to total fractures and hip fractures, as presented in the recently published erratum. Our subanalyses contained a total of eight RCTs [10, 34‐36, 38, 39, 42, 43] assessing the effect of calcium plus vitamin D supplementation versus placebo on total fracture incidence and six RCTs [10, 34‐36, 42, 43] assessing the effect of calcium plus vitamin D supplementation versus placebo on hip fracture incidence (Figs. 2 and 3). A total of 195 hip fracture events and 2231 total fracture events based on 30,970 participants analyzed across all studies were evaluated meta-analytically for the subanalyses on total fractures (Fig. 2) and hip fractures (Fig. 3). Follow-up in the trials ranged from approximately 1 to 7 years. Two studies analyzed participants in an institutionalized study setting, whereas six studies analyzed community-dwelling participants. The calcium dosages ranged from 500 mg/day in one study to 1000–1200 mg/day in the remaining studies. Six studies provided 800 IU/day vitamin D, whereas dose levels were 400 and 700 IU/day in the remaining two studies.
Fig. 2
Calcium plus vitamin D supplementation versus placebo and total fracture. a Meta-analysis of eight RCTs. b Funnel plot of standard error by log rate ratio for calcium plus vitamin D supplementation and risk of total fracture. aBased on data from Table 6 in Prentice et al. [10] regarding adherence to study pills and no personal supplements. CI confidence interval, SSRE summary relative risk estimate
Fig. 3
Calcium plus vitamin D supplementation versus placebo and hip fracture. a Meta-analysis of six RCTs. b Funnel plot of standard error by log rate ratio for calcium plus vitamin D supplementation and risk of hip fracture. aBased on data from Table 6 in Prentice et al. [10] regarding adherence to study pills and no personal supplements. CI confidence interval, SSRE summary relative risk estimate
×
×
As mentioned above, before conducting these de novo meta-analyses, we replicated the findings from the Tufts EPC evidence report corrected erratum (SRRE comparing calcium plus vitamin D and total fracture versus placebo, 0.91; 95 % CI, 0.81–1.01) [44]. The SRRE of this analysis changed slightly (SRRE, 0.89; 95 % CI, 0.79–1.01) after making some analytical modifications and using multivariate RRs extracted directly from some studies. In the current meta-analyses, we replaced the WHI data from Jackson et al. [9] with updated data from Prentice et al. [10]. Meta-analysis of calcium plus vitamin D supplementation (versus placebo) using the subanalysis by Prentice et al. [10] resulted in a statistically significant 14 % reduction in total fractures (SRRE, 0.85; 95 % CI, 0.73–0.98; using data for adherence to assigned pills and no personal supplements from Table 6 in Prentice et al. [10]) (Fig. 2a).
Visual inspection of the funnel plot for the overall model of calcium plus vitamin D supplementation and total fracture indicated slight publication bias (Fig. 2b), and the Egger’s regression test produced a statistically significant P value (0.04). However, this publication bias assessment was skewed because the WHI clinical trial published by Prentice et al. [10] and the Randomised Evaluation of Calcium or Vitamin D clinical trial published by Grant et al. [38] were considerably larger than all of the other studies in the model—contributing approximately 50 % of the relative weight. Despite this, the SRREs ranged between 0.82 and 0.90 after removal of each individual study in our one-study-removed influence analysis. In a sensitivity analysis, removing the studies by Prentice et al. [10] and Grant et al. [38] simultaneously resulted in an SRRE of 0.77 (95 % CI, 0.63–0.94) with a P value for heterogeneity of 0.256. Collectively, two individual studies reported null associations between calcium plus vitamin D supplementation and total fracture, whereas the remaining studies observed decreased risks of fracture (two of these associations were statistically significant). Meta-analysis of the six studies of total fracture involving community-dwelling participants [10, 36, 38, 39, 42, 43] resulted in an SRRE of 0.95 (95 % CI, 0.85–1.06), whereas the SRRE for the two studies among institutionalized participants [34, 35] was 0.67 (95 % CI, 0.52–0.88).
We conducted sensitivity analyses for total fracture using all data sources from the WHI trial; however, summary associations were modified only slightly. When data for adherence to assigned pills (personal supplements included; Table 6 in Prentice et al. [10]) were used, the SRRE for calcium plus vitamin D supplementation (versus placebo) was 0.87 (95 % CI, 0.76–1.00). When overall data for calcium plus vitamin D supplementation (versus placebo) were used (Table 2 in Prentice et al. [10]), the summary associations were 0.88 (95 % CI, 0.77–1.00) and 0.87 (95 % CI, 0.76–1.00) for all study participants and for study participants with no personal supplement use, respectively.
Calcium plus vitamin D supplementation (versus placebo) resulted in a statistically significant 30 % decreased risk of hip fractures based on meta-analysis of six trials (SRRE, 0.70; 95 % CI, 0.56–0.87) (Fig. 3a). The individual study RRs ranged between 0.36 and 0.75, except for the outlier study by Salovaara et al. [43], for which an RR of 2.02 was reported (Fig. 3a). However, this study provided very little relative weight to the overall model, and its removal did not alter the overall effect size. As with the findings for total fracture, statistically significant reductions in hip fracture risk remained when data for adherence to assigned pills only (Table 6 in Prentice et al. [10]), no personal supplements only (Table 2 in Prentice et al. [10]), and all groups combined (Table 2 in Prentice et al. [10]) were analyzed. A borderline statistically significant 38 % reduction in hip fracture risk was observed in the meta-analysis of four studies involving community-dwelling participants [10, 36, 42, 43] (SRRE, 0.65; 95 % CI, 0.41–1.01). Only two studies reported hip fracture events among institutionalized participants [34, 35], but the risk reduction was significant (SRRE, 0.71; 95 % CI, 0.56–0.91). No evidence of publication bias was apparent after inspection of the funnel plot for hip fracture (Fig. 3b) and based on Egger’s regression test (P = 0.901). Furthermore, all meta-analysis models for hip fracture were homogeneous, and results were consistent within and between models. Statistical significance remained after our one-study-removed influence analysis with SRREs ranging between 0.64 and 0.73, indicating the statistical robustness of calcium plus vitamin D supplementation on hip fracture prevention.
Discussion
Our meta-analysis substituting the study by Jackson et al. [9] with the subanalysis by Prentice et al. [10] showed statistically significant reductions in risk for both total and hip fractures, which supports the use of calcium plus vitamin D supplementation to reduce fracture risk. Identification of strategies to reduce fracture risk is important, given that osteoporosis and low bone mass affected an estimated 53.6 million Americans aged >50 years in 2010 [46]. Over two million osteoporosis-related fractures occur each year in the United States, accounting for >$19 billion in annual healthcare costs [47]. National surveys show that many Americans do not consume recommended amounts of calcium and vitamin D [48, 49]. Both nutrients are important for optimal skeletal health across the lifecycle: calcium is the dominant mineral in bone, and vitamin D is important for the efficient absorption of calcium and for effective functioning of bone cells.
Anzeige
Our meta-analysis differs from the 2011 Tufts EPC evidence report [7] and corrected erratum [44] in several ways. One important difference is our use of the data from the WHI published by Prentice et al. [10], which focused on a subset of participants in the WHI randomized clinical trial who did not use personal supplements at baseline and who were adherent to study pills. By contrast, the Tufts EPC evidence report [7] and corrected erratum [44] included WHI results from all women in the randomized clinical trial arm of the WHI that was designed to assess calcium plus vitamin D supplementation without regard to personal supplement use or adherence to study pills [9]. The differences in these two meta-analyses may partially explain the difference in findings between the two WHI analyses. For example, Prentice et al. [10] found a significant reduction in fracture risk associated with the use of calcium plus vitamin D supplements, whereas Jackson et al. [9] found that supplementation did not reduce hip fracture incidence in the overall cohort (subcohort analysis of adherent individuals showed a significant effect on hip fracture reduction). There are strengths associated with including the results of Prentice et al. [10] rather than the results of Jackson et al. [9]. Specifically, Prentice et al. [10] focused on those individuals who took the supplements. In addition, their study design also improved the ability to assess the effect of a threshold nutrient such as calcium, because efficacy of interventions for threshold nutrients cannot be established in individuals who are already sufficient [50]. Thus, we concluded that the results of Prentice et al. [10] were more appropriate because they considered adherent participants who were not already taking supplements at baseline. However, per-protocol analysis is a concern because subanalysis jeopardizes the assumptions of randomization. Some would argue that we have no trial data with high enough retention rates in individuals who were sufficiently compliant with treatment to have the needed evidence to make conclusions about calcium plus vitamin D supplementation [51]. However, treatments cannot work if they are not taken. Thus, the study by Prentice et al. [10], which considers adherent participants who were not already taking supplements at baseline, is what the authors of the present study consider to be the most nutritionally relevant evidence from the WHI available at this time. Our study is further limited by the lack of published data on the number of subjects taking personal supplements at baseline and/or adherence among participants in other trials included in the analyses. For example, based on questionnaire responses collected at 24 months during the RECORD trial, only 2886 (54.5 %) of the 5292 participants were still taking tablets (8.5 % had died, 1.1 % had withdrawn, and 35.8 % had stopped taking tablets but were still providing data on at least the main outcomes) [38].
In addition, we extracted multivariate RR data if reported in the individual study, rather than calculate a crude RR based on the number of events and total participants. We did not generate models or conduct analyses based on a study quality assessment. Rather, we conducted one-study-removed sensitivity analyses to determine the relative impact of each study on the overall model and found summary effects that did not deviate from the overall effect size, indicating the robustness of the analyses. This is important when assessing generalizability of the findings on various population groups such as the two studies [38, 39] of individuals with a history of fracture. There was some evidence of publication bias for total fracture results, but summary associations remained statistically significant after removal of each individual study in our influence analysis, which suggests that the impact of this publication bias was not large.
Other recent meta-analyses have found null effects of vitamin D supplementation alone on fracture outcomes [7, 52, 53]. Although vitamin D is used to support bone health, the current evidence for an effect of supplemental vitamin D alone on fracture outcomes is limited and conflicting. Large-scale, randomized controlled studies testing whether supplemental vitamin D versus placebo has effects on fracture outcomes are needed and are currently underway. The Vitamin D and Omega-3 Trial (VITAL), in studies sponsored by the National Institutes of Health, is currently testing the effects of supplemental 2000 IU vitamin D (cholecalciferol) on fracture outcomes among 25,875 women and men across the United States [54].
It is well known that vitamin D promotes calcium absorption in the gut and helps to maintain adequate serum calcium concentrations to enable normal mineralization of the bone. Vitamin D is needed for bone growth and bone remodeling by osteoblasts and osteoclasts. Thus, calcium and vitamin D work together synergistically on the bone, and the results of our meta-analysis support their combined use to reduce fracture risk. Furthermore, the dosage of vitamin D administered in the WHI (400 IU/day) may not have been high enough to adequately influence fracture outcomes. This might also partially explain the null findings reported in previous meta-analyses of calcium plus vitamin D supplementation, given the relatively large influence of the WHI on results in these meta-analyses. The dose of vitamin D administered in the WHI was lower than any other RCT included in this updated meta-analysis.
Anzeige
In conclusion, combined calcium plus vitamin D supplementation is statistically significantly associated with reduced total and hip fractures across various populations. Collectively, decreased risks for hip fractures were stronger in magnitude, and results were more homogeneous compared with total fractures, but consistent decreased risks were observed for both fracture outcomes. Our analyses indicate that supplementation could decrease the risk of total and hip fractures by 15 and 30 %, respectively, which could decrease the public health burden of osteoporotic fractures. Our meta-analysis updates and expands the current state of the science on this public health issue and clinically important topic area. Additional clinical RCTs that address personal use of supplements and adherence to allocated interventions may better facilitate our understanding of the role of supplemental calcium plus vitamin D and vitamin D alone on fracture prevention. The findings from this quantitative assessment support the use of calcium plus vitamin D supplements as an intervention for fracture risk reduction in both community-dwelling and institutionalized middle-aged to older adults.
Acknowledgments
Funding for this study was provided through unrestricted educational grants from the Consumer Healthcare Products Association, the Council for Responsible Nutrition, and the Natural Products Association. The funding bodies had no influence on the study design; the collection, analysis, and interpretation of data; the writing of the report; and the decision to submit the paper for publication.
Compliance with ethical standards
Conflicts of interest
Connie M. Weaver, Joan M. Lappe, and Meryl S. LeBoff are members of the Board of Trustees of the National Osteoporosis Foundation. Taylor C. Wallace is currently employed by the National Osteoporosis Foundation. Connie M. Weaver is a member of the scientific advisory board of Pharmavite LLC and is supported by the National Institute of Child Health and Human Development (Award Number HD061908). Dominik D. Alexander is a consultant to the National Osteoporosis Foundation. Meryl S. LeBoff is supported by the National Institute of Arthritis and Musculoskeletal and Skin Diseases (Award Numbers AR060574 and AR059775). Bess Dawson-Hughes is a member of the scientific advisory boards of OPKO, Eli Lilly, and Pfizer and is supported by the National Institute of Arthritis and Musculoskeletal and Skin Diseases (AR R01AR060261-01A1), the National Institute of Diabetes and Digestive and Kidney Diseases (U01DK098245), and the US Department of Agriculture. Carol J. Boushey and Shanshan Liu, Anne C. Looker, and Ding D. Wang report no conflicts of interest.
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
