Reliability and validity of miniscrews as references in cone-beam computed tomography and intraoral scanner digital models: study on goat heads

Traditional orthodontic records including plaster dental models, facial and intra-oral photos, panoramic radiographs and lateral cephalograms could be used to monitor treatment progress and outcomes. Superimposing serial cephalograms has been used widely to determine the skeletal and dental changes that occur over time. Stable structures are the keys to a good superimposition. These structures described in Melsen’s research of cranial base growth [1], Bjork and Skieler’s implant research [2, 3], as well as Enlow’s investigation of remodeling [4] are also suggested by American Board of Orthodontics. The locations of these natural stable structures in maxilla and mandible were best found with external metal implant references, and the superimposition of serial cephalograms on metallic implants is considered to be the best technique.

Increasing developments in acquisition of medical images and 3D digital technologies have initiated revolutionary changes in orthodontics. Of recent, CBCT, digital dental models and 3D facial photos have become popular orthodontic records. The reliability and validity of these digital records have to be verified before they are used to make diagnosis and treatment plan. Similar to 2D cephalometric superimposition, orthodontists have tried to register serial 3D digital models to monitor treatment changes over time in three-dimensions. And a great number of studies have focused on CBCTs and digital dental models superimposition.

CBCT has been proven to be a valid 3D representation of the skull that is suitable for clinical and laboratorial usage. It is not difficult to superimpose non-growing patients’ serial CBCT models because several stable craniofacial structures can be used as references [5‐7]. However, it is still challenging to do so on growing patients because 3D stable structures in jaws have not been identified. Superimposing on external references will be necessary to analyze changes in jaws of growing patients [8]. Parton et al. [9] attempted to superimpose mandibular structures in growing rabbits with the aid of implants. Nguyen et al. [10] identified stable mandibular structures in three dimensions in growing patients with the aid of bone plates.

Recent decades have also witnessed remarkable advancements in digital dental model technologies, from stone dental model scanning to direct intraoral scanning. Digital software makes superimposition of serial dental models possible. Palatal rugae have historically been used to perform 2D measurements on 3D dental models [11‐13]. With the aid of miniscrews, Jang et al. [14] and Chen et al. [15] evaluated the stability of the palatal region and established a 3D superimposition method for analyzing orthodontic tooth movement in maxillary dental models, respectively. However, it is still unknown how to superimpose serial digital dental models in growing patients, and again, metallic implants such as miniscrews could be identified as external references in a future study. Beforehand, the positional stability of miniscrews during orthodontic treatment should be evaluated, because only stable miniscrews could be used as references. The linear distance and angle measurements between miniscrews are two methods applied in previous studies [8, 16].

What calls for noteworthy attention is that studies showed that artifact caused by the metallic implant in CBCT will degrade image quality [17], which could bring errors into the procedure of implant superimposition. Park et al. [18] also found that the borders of metal brackets were blurred in image created by certain type of IOS. Another literature disagreed with the use of IOSs for impression capture of multiple dental implants, aimed at the manufacture of extended implant-supported restorations as full arches [19]. Previous studies have confirmed the reliability and accuracy of digital images about anatomy on jaws bones or dentition by comparing the linear distance between landmarks on digital images with actual values [20‐27]. However, no study has quantified the systematic error of digital miniscrew images.

The aim of this study is to evaluate the reliability and validity of linear and angular measurements of miniscrews in CBCT at different voxel sizes and IOS. This was the first attempt to quantify the systematic errors of miniscrew images and test the reliability of miniscrew measurements on CBCT and IOS, and we hope that the result could be served as justification for further evaluation of miniscrew stability and application of miniscrew superimposition on 3D models.

Four goat maxillae and four mandibles were obtained from the agricultural market for human daily consumption. The goats had already been sacrificed at the time of purchase. For this experiment and under these conditions, the research did not require approval from the regional ethical committee for research ethics due to national legislation. The lower jaw was dissected further into two hemi-mandibles to make direct scanning possible. Maxillae and hemi-mandibles underwent miniscrew (11 mm × 1.6 mm; Ci Bei, Zhejiang, China) implantation by two experienced orthodontists. Two miniscrews were placed on the buccal and lingual sides of each maxilla and hemi-mandible. At least one miniscrew on each hemi-mandible penetrated out of the cortical bone from one side to another (Fig. 1a, d). In all, 64 miniscrews were inserted.

Seventy-five paired linear measurements (35 homolateral measurements and 40 contralateral measurements) at 0.12-mm voxels, 31 linear measurement (20 homolateral measurements and 11 contralateral measurements) at 0.3-mm voxels and 11 angles were evaluated. Intra- and inter-operator reliability using ICC was 0.961–1.000.

Linear measurements by 3D models from CBCT at 0.12-mm voxels (termed “CBCT1” in all Tables) and 0.3-mm voxels (CBCT2) demonstrated overestimates on homolateral and contralateral sides compared with the paired results using the digital caliper (Table 1). The mean biases were 0.31 ± 0.20 mm and 0.25 ± 0.28 mm at 0.12-mm voxels, and 0.11 ± 0.21 mm and 0.19 ± 0.26 mm at 0.3-mm voxels. All 95% confidence intervals (CIs) were > 0 mm but < 0.5 mm. The only significant difference using the IOS relative to digital caliper pairs was observed on homo-lateral linear measurements. An equal amplification effect on sagittal and transverse directions was revealed by a one-sample t-test at 0.12-mm voxels and 0.3-mm voxels of CBCT with caliper measurements, whereas a significant increased enlargement was observed on the homo-lateral side using the IOS (Tables 1, 2). In total, significantly larger results were observed compared with value obtained using digital caliper pairs. Also, results at 0.12-mm voxels using CBCT were significantly larger than all other values (Table 4).

Angle measurements revealed good validity among the three digital methods compared with true values (Table 3). Values for standard deviation and ranges of 95%CIs were large. Significant differences among the three digital models were not observed (Table 4).

Superimposing orthodontic records at different time points has been used widely to determine the craniofacial changes. The cornerstone of superimposition is using stable structures. Identification of stable structures in jaws without having external references in growing patients is extremely challenging. In history, metal implants have been used as reference in 2D cephalograms to explore natural stable structure [2, 3]. In 3D era, implants should continually play a crucial role in CBCT [8‐10] and digital dental model superimposition [14, 15]. However, metallic implants would produce artifacts both in CBCT and IOS images, which would degrade the image quality and introduce errors. In this study, the experimental animal skulls, which are more feasible and less expensive than human skulls, were used to evaluate the reliability and validity of linear and angle measurements of 3D miniscrews on CBCT and IOS with actual values. The results of our study are applicable on human skulls as well, because the goat heads are merely platforms for miniscrew implantation. Moreover, the study is ethically impossible to be conducted on patients because of the amount of radiation exposure necessary when taking CBCT at different resolutions.

Our study showed that statistically significant overestimations of linear measurements were obtained on CBCT both at 0.12 (0.27 ± 0.24 mm) and 0.3 (0.14 ± 0.22 mm) voxels compared with actual measurements. Our results are, to some extent, consistent with several studies. Moshfeghi et al. [20] using gutta-percha, reported an enlargement by 0.10 ± 0.99 mm in axial section and 0.27 ± 1.07 mm coronal section at 0.3 voxels. However, the values for standard deviation were greater than our data. Tolentino et al. [21] used silica markers, but they did not observe statistical difference among voxels at 0.25, 0.3 or 0.4 mm. Variable materials used as references in different studies may attribute to the contradiction between studies. Schulze et al. [29] pointed that an extreme artifact could be produced by titanium implants. Instead of upgrading resolution, they suggested a more sophisticated reconstruction algorithm for meaningful reduction of artifacts. Moreover, when using linear measurement to evaluate the stability of miniscrews, the systematic error should be taken into consideration.

Secondly, miniscrews at two voxel settings presented reliable and accurate results on angle measurements when compared with actual values. Our result supported the use of angular measurements acquired through miniscrews in clinical applications, which is important on measuring the angle stability of miniscrews after orthodontic loading [16].

CBCT is limited for evaluation of short-term treatment effects due to excess radiation exposure to the patients. Thus, chairside IOS is promising for this purpose. DeLong et al. [30] found that a smooth textured surface (such as the titanium miniscrews used in our study) could worsen the digitizing performance due to spectral reflection. However, our study confirmed the clinical reliability and validity of IOS for linear and angular measurements of miniscrews, which were consistent with other studies. However, these measurements were different with respect to systematic errors and their tendencies [22‐27]. Our results supported that the evaluation of tooth movement on serial digital dental models from IOSs during growth or after orthodontic intervention is operable. In addition, we also found it quite interesting that the mean bias on the homolateral side was significantly larger than that on the opposite, implying unequal magnification in sagittal and transverse directions. Anh et al. [31] claimed that regions imaged later would generate more errors during configuration than regions imaged earlier. Thus, the scanning sequence could be one of the reasons for the unequal amplification effect observed in our study, and a modification is required when miniscrews are involved.

Above all, in accordance with results of literatures and this study, the following suggestions are proposed when miniscrews are used to superimpose 3D image: 1.The positional stability of miniscrews should be evaluated in order to ensure the reliability and clinical validity of the linear and angular measurements on 3D models. 2. The same CBCT machine with the same scanning settings is required when doing superimposition. 3. Systematic errors of miniscrew measurements on CBCT image and digital dental models acquired from IOS should be consider when stable structures are explored.

A limitation of this study is the exclusion of motion artifacts because this is an experiment on dry goat jaw bone. In addition, the study was conducted for a single experimental condition by testing systematic errors on a specific type of miniscrew, a single CBCT machine and one IOS. Whether the results of this study are suitable for other miniscrews, other CBCT machines at different voxel sizes, or other IOSs is not known.