Recent Applications of Scanning Microscopy in Surface Engineering 2020View this Special Issue
Research Article | Open Access
Hong Xin Cai, Qi Jia, HaoYu Shi, Yujie Jiang, Jingnan Xue, ChunXu Chen, Haotian Gong, Jie Liu, Eui-Seok Lee, Heng Bo Jiang, "Accuracy and Precision Evaluation of International Standard Spherical Model by Digital Dental Scanners", Scanning, vol. 2020, Article ID 1714642, 6 pages, 2020. https://doi.org/10.1155/2020/1714642
Accuracy and Precision Evaluation of International Standard Spherical Model by Digital Dental Scanners
With the popularization of digital technology and the exposure of traditional technology’s defects, computer-aided design and computer-aided manufacturing (CAD/CAM) has been widely used in the field of dentistry. And the accuracy of the scanning system determines the ultimate accuracy of the prosthesis, which is a very important part of CAD/CAM, so we decided to evaluate the accuracy of the intraoral and extraoral scanners. In this study, we selected the sphere model as the scanning object and obtained the final result through data analysis and 3D fitting. In terms of trueness and precision, the scanner of SHINING was significantly different from that of others; however, there was no significant difference between TRIOS and CEREC. SHINING showed the lowest level of accuracy, with CEREC slightly lower than TRIOS. The sphere model has also been proven to be scanned successfully.
With the emergence of digitalization, CAD/CAM systems  have found an increasingly wide utilization in the field of prosthodontics on account of its considerable strengths . Given the fact that the traditional prostheses gradually fail to meet the needs of patients, the use of intraoral  and extraoral scanners in dentistry is becoming more and more common [4, 5].
By using the specific and intuitive model presented from intraoral and extraoral scanners [6–9], we can immediately obtain detailed information of the patient’s oral cavity and its digital files. And the files will be imported into the computer to complete the design and production . The extraoral scanner scans the impression model, and the intraoral scanner directly scans the patient’s oral cavity . Compared to the traditional technology, the scanning technology is undoubtedly time-saving and efficient [11, 12].
There are many factors that affect the scanning results and data collection. Recent studies have shown that different scanning strategies can affect the accuracy of results . It has been reported that different scanning systems also contribute to different experimental results . In addition, the selection of the impression materials and operation time will affect the accuracy of extraoral scanners, while the scanning range, light , and oral tissue will affect intraoral scanners [16, 17].
Considering the above factors, it is of clinical significance to evaluate the accuracy of intraoral and extraoral scanners . The early Flügge’s study claimed that the extraoral scanners performed better than intraoral scanners under the oral environment . However, as the algorithms and scanning techniques evolve, Tomita et al. concluded that the intraoral scanners had higher accuracy than extraoral scanners as they were studying their self-manufactured denture model in vitro . Further, the performance of the intraoral scanner is significantly influenced by the geometry of the scanned object, for the fact that it accumulates the scanned image and records the scanning path of the object to obtain the complete image. Especially, the uniformity of the model will also reduce the performance of the intraoral scanner. Therefore, this study is based on an international standard model to evaluate the accuracy of intraoral and extraoral scanners [19, 20].
After looking up a lot of literature, we found that there were few papers based on the sphere model , so this experiment adopted the ISO standard sphere model . According to the definition of accuracy regulated in ISO 5725 including trueness and precision, the trueness refers to the degree of uniformity between a measurement result and the reference value, while the latter one maintains the uniformity between independent measurement results. According to the standard in ISO 3290-2, we chose a sphere with Grade 20 to conduct the experiment. And the error of diameter and surface less than 0.001 mm can be ignored in this grade .
2. Materials and Methods
2.1. Fabrication of Models
According to the clinical practice, the theoretical value of the diameter of the sphere model based on the ISO 12836  was set as 8 mm, as shown in Figure 1(a). The 3D file of the model was drawn by computer-aided design software (AutoCAD 2018, Autodesk, USA), which was exported in stereolithography (STL) format. The test model was made of stainless steel, and we used computer numerical controlled (CNC) milling to fabricate it. Moreover, the model was sandblasted with a powder size of 80 μm as specified by the international standard.
2.2. Creation of Gold Standard Values
Thirty measurements of the sphere model’s diameter were taken by Vernier Calipers, the average of which was taken as the truth value in this paper. One of the measurements was shown in Figure 1(b). The true value was set as the gold standard for evaluation, and the 3D file based on the value was created as the gold standard file for 3D fitting.
2.3. Scanning Process
One extraoral scanner (SHINING D200+, CHN) and two intraoral scanners (CEREC AC D3492, Sirona, GER and TRIOS T12A, 3Shape, DEN), respectively, performed 30 scans of the sphere model and saved them as STL files. The model was scanned by the same skilled technician who followed the scanning method recommended by the different instrument manufacturers to eliminate interference and improve feasibility .
2.4. Data Acquisition and Image Matching
The scanned original files were converted into STL files, which were then imported into a reverse engineering software (Geomagic Control X 2018, 3D SYSTEMS, USA). The test indicator (diameter) was measured and recorded through the software, and the 3D files of test groups were compared with the gold standard files for 3D fitting. Meanwhile, root mean square error (RMSE) values were recorded.
2.5. Mathematical Analysis
The formula for accuracy assessment is as follows :
Perform statistical analysis on scanned data using SPSS v.20.0 (IBM, USA). The data conform to a normal distribution, but they are not conformable in the homogeneity of the variance. The Nonparametric Kruskal-Wallis test analyzed the difference in parameters and the result of attested statistically significant differences.
3.1. Absolute Mean Trueness and Precision of the Sphere Model
The value of absolute mean trueness and precision of the sphere model is enumerated in Table 1. Figure 2(a) shows boxplots of the absolute mean trueness values, and Figure 2(b) shows boxplots of the absolute mean precision values of the sphere model. Regarding diameter errors of the sphere model, the TRIOS reveals the highest trueness and precision, respectively. The comparison between the intraoral scanners and the extraoral scanners shows that compared to the CEREC and SHINING, the mean trueness value of TRIOS is much lower. The mean precision value of TRIOS is significantly lower than CEREC and SHINING.
3.2. Relative Errors of Sphere Model
Table 2 shows the relative errors of the trueness and precision of the sphere model. The relative errors of the sphere model are less than 0.008 mm, respectively. This is an ideal result that when comparing the relative errors of trueness and precision between these scanners, the trend is similar to that of the absolute mean deviation of trueness and precision.
3.3. Broken Line Graph and RMSE
The broken line graph of the original data of the sphere model diameter measured by scanners is shown in Figure 3. The yellow line is the gold standard. It is obvious that SHINING’s values are not concentrated and far from the yellow line. We found that the values of CEREC and TRIOS were very close to the gold standard, also highly centralized and accurately combined with RMSE in Table 3.
3.4. 3D-Fitting Measurement
Figure 4 shows a 3D-fitting comparison of the digital impression between test groups and the control group. The difference in colors other than green represents the difference between the measured value and the gold standard. More green areas mean the scanned image more accurate. The results show that there is a larger error of SHINING compared with other scanners, and a large area is lower than the control group. The fitting result of TRIOS is the best with the largest green area.
3.5. Analysis of Significant Difference
We find that there is no significant difference between CEREC and TRIOS, but the absolute mean precision values of the CEREC are significantly lower than TRIOS through statistical analysis. And SHINING is different from CEREC and TRIOS in terms of precision and trueness obviously.
In this study, the accuracy of intraoral and extraoral scanners was evaluated by a sphere model described in ISO 12836 . The sphere model is of positive geometry with a precision limited to 0.0002 mm, made of dimensionally stable stainless steel. There have been many studies evaluating the accuracy of scanners by Inlay-cavity die and Grown-and-bridge die, but few studies are based on the sphere model because it is difficult to be identified by the intraoral scanner.
Arakida et al. assessed the influence of ambient light illumination and color temperature on the authenticity and accuracy of a digital signal and proved that the conditions of 3900 k and 500 lux are the most suitable conditions for digital scanning . Sun et al. compared the reproducibility of intraoral scanners in vivo and in vitro, respectively, and the results showed that the reproducibility was comparable, so different scanning environment will affect the scanning results of intraoral scanners .
According to the scanning standard described in ISO 12836 , the scanning process of each scanner was executed 30 times with room temperature of ()°C and the change of temperature controlled within ±1°C, which we had followed to minimize the error caused by external interference.
There are still many factors like equipment or manual operations that can affect the accuracy of the scanner . Therefore, we designed some schemes aimed at these problems to minimize their impact on accuracy. The scanning principle and operation methods of intraoral and extraoral scanners in this experiment are different. And we added a base at the bottom of the sphere model for proper operation. If the operator had touched the sphere directly by hand in the experiment, the surface of the model would have changed greatly and thus the final result would have been affected. Thus, it is necessary to add the base which can also fix the sphere model to make scanning easier.
Reproducibility and repeatability are also important components of the evaluation . Reproducibility can be defined as the consistency of the measured results of the same object under different conditions, while repeatability is affected by operating, timing, equipment, etc. Therefore, this experiment was carried out by a skilled operator in strict accordance with the methods specified by the scanner manufacturers to reduce the influence of operation.
There is no significant difference between values obtained in the experiment and the standard values created from the model, so it is feasible to scan the sphere model with these three scanners.
There are limitations to our experiments as well. The long operation of the scanner may result in the degradation of the performance, which may affect the scanning results of the latter part. And the choice of a single model has some limitations in the evaluation of scanners. In terms of the clinic, due to the complex oral environment, like saliva, blood, and soft tissue, there will be deviations in the actual operation [28, 29]. Additionally, the level of analysis and measurement software used also affects the results.
According to the study of Burzynski et al., with the progress of intraoral scanning technology, the shrinking of the camera, and the acceleration of acquisition time, patients may show a greater preference for digital impression . Through investigation, Ahmed et al. found that with the development of digitization and the improvement of scanner accuracy, people’s acceptance of using CAD/CAM for oral disease treatment has gradually increased . Alghazzawi argued that the coming trend for most practitioners would be the use of an acquisition camera attached to a computer that was equipped with appropriate software and the capability of forwarding the image to the laboratory .
Our experiment compared one extraoral scanner (SHINING) with two intraoral scanners (CEREC, TRIOS), whose results showed that the accuracy of CEREC was between the other two. It indicated that the intraoral scanners were better than the extraoral one. Since no controversy was shown in the results of this experiment, the results of clinical trials of the extraoral and intraoral scanners need further discussion.
The accuracy of the intraoral scanners in this experiment was greater than that of the extraoral scanner. The intraoral scanner has certain reliability in practical application and is worth to trial in clinics. The sphere model is achievable as a scanning object, but it requires further research and improvement.
The data used to support the findings of this study are included within the article.
Conflicts of Interest
We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work.
HongXin Cai, Qi Jia, and HaoYu Shi contributed equally to this work.
The authors thank the CONVERSATIONALIST club in Shandong First Medical University School of Stomatology. This study was funded by the Shandong First Medical University & Shandong Academy of Medical Sciences of PhD Start-up Project (Jiang-161839).
- M. J. Peluso, S. D. Josell, S. W. Levine, and B. J. Lorei, “Digital models: an introduction,” Seminars in Orthodontics, vol. 10, no. 3, pp. 226–238, 2004.
- M. Santoro, S. Galkin, M. Teredesai, O. F. Nicolay, and T. J. Cangialosi, “Comparison of measurements made on digital and plaster models,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 124, no. 1, pp. 101–105, 2003.
- M. Imburgia, S. Logozzo, U. Hauschild, G. Veronesi, C. Mangano, and F. G. Mangano, “Accuracy of four intraoral scanners in oral implantology: a comparative in vitro study,” BMC Oral Health, vol. 17, no. 1, p. 92, 2017.
- R. Nedelcu, P. Olsson, I. Nyström, J. Rydén, and A. Thor, “Accuracy and precision of 3 intraoral scanners and accuracy of conventional impressions: a novel in vivo analysis method,” Journal of Dentistry, vol. 69, pp. 110–118, 2018.
- S. Shimizu, A. Shinya, S. Kuroda, and H. Gomi, “The accuracy of the cad system using intraoral and extraoral scanners for designing of fixed dental prostheses,” Dental Materials Journal, vol. 36, no. 4, pp. 402–407, 2017.
- L. O. L. Bohner, G. De Luca Canto, B. S. Marció, D. C. Laganá, N. Sesma, and P. T. Neto, “Computer-aided analysis of digital dental impressions obtained from intraoral and extraoral scanners,” The Journal of Prosthetic Dentistry, vol. 118, no. 5, pp. 617–623, 2017.
- G. H. Park, K. Son, and K. B. Lee, “Feasibility of using an intraoral scanner for a complete-arch digital scan,” The Journal of Prosthetic Dentistry, vol. 121, no. 5, pp. 803–810, 2019.
- A. P. Keating, J. Knox, R. Bibb, and A. I. Zhurov, “A comparison of plaster, digital and reconstructed study model accuracy,” Journal of Orthodontics, vol. 35, no. 3, pp. 191–201, 2008.
- S. B. Patzelt, A. Emmanouilidi, S. Stampf, J. R. Strub, and W. Att, “Accuracy of full-arch scans using intraoral scanners,” Clinical Oral Investigations, vol. 18, no. 6, pp. 1687–1694, 2014.
- S. Logozzo, E. M. Zanetti, G. Franceschini, A. Kilpelä, and A. Mäkynen, “Recent advances in dental optics – part i: 3d intraoral scanners for restorative dentistry,” Optics and Lasers in Engineering, vol. 54, pp. 203–221, 2014.
- S. B. Patzelt, S. Bishti, S. Stampf, and W. Att, “Accuracy of computer-aided design/computer-aided manufacturing-generated dental casts based on intraoral scanner data,” Journal of the American Dental Association, vol. 145, no. 11, pp. 1133–1140, 2014.
- R. van Noort, “The future of dental devices is digital,” Dental Materials, vol. 28, no. 1, pp. 3–12, 2012.
- T. V. Flugge, S. Schlager, K. Nelson, S. Nahles, and M. C. Metzger, “Precision of intraoral digital dental impressions with itero and extraoral digitization with the itero and a model scanner,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 144, no. 3, pp. 471–478, 2013.
- D. T. Chandran, D. C. Jagger, R. G. Jagger, and M. E. Barbour, “Two- and three-dimensional accuracy of dental impression materials: effects of storage time and moisture contamination,” Bio-medical Materials and Engineering, vol. 20, no. 5, pp. 243–249, 2010.
- B. Giménez, M. Özcan, F. Martínez-Rus, and G. Pradíes, “Accuracy of a digital impression system based on active triangulation technology with blue light for implants: effect of clinically relevant parameters,” Implant Dentistry, vol. 24, no. 5, pp. 498–504, 2015.
- T. Grunheid, S. D. McCarthy, and B. E. Larson, “Clinical use of a direct chairside oral scanner: an assessment of accuracy, time, and patient acceptance,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 146, no. 5, pp. 673–682, 2014.
- J. Maeng, Y. J. Lim, B. Kim, M.-J. Kim, and H.-B. Kwon, “A new approach to accuracy evaluation of single-tooth abutment using two-dimensional analysis in two intraoral scanners,” International Journal of Environmental Research and Public Health, vol. 16, no. 6, article 1021, 2019.
- Y. Tomita, J. Uechi, M. Konno, S. Sasamoto, M. Iijima, and I. Mizoguchi, “Accuracy of digital models generated by conventional impression/plaster-model methods and intraoral scanning,” Dental Materials Journal, vol. 37, no. 4, pp. 628–633, 2018.
- F. Emir and S. Ayyildiz, “Evaluation of the trueness and precision of eight extraoral laboratory scanners with a complete-arch model: a three-dimensional analysis,” Journal of Prosthodontic Research, vol. 63, no. 4, pp. 434–439, 2019.
- J. L. Porter, C. K. Carrico, S. J. Lindauer, and E. Tüfekçi, “Comparison of intraoral and extraoral scanners on the accuracy of digital model articulation,” Journal of Orthodontics, vol. 45, no. 4, pp. 275–282, 2018.
- International Standard (ISO) 12836, Dentistry —Digitizing Devices for CAD/CAM Systems for Indirect Dental Restorations— Test Methods for Assessing Accuracy, International Organization for Standardization, Geneva, Switzerland, 2nd edition, 2015.
- R. G. Nedelcu and A. S. Persson, “Scanning accuracy and precision in 4 intraoral scanners: an in vitro comparison based on 3-dimensional analysis,” The Journal of Prosthetic Dentistry, vol. 112, no. 6, pp. 1461–1471, 2014.
- ADA/ANSI Standard No. 132, Scanning Accuracy of Dental Chairside and Laboratory CAD/CAM System, American Dental Association, Chicago, IL, USA, 2015.
- T. Arakida, M. Kanazawa, M. Iwaki, T. Suzuki, and S. Minakuchi, “Evaluating the influence of ambient light on scanning trueness, precision, and time of intra oral scanner,” Journal of Prosthodontic Research, vol. 62, no. 3, pp. 324–329, 2018.
- L. Sun, J. S. Lee, H. H. Choo, H. S. Hwang, and K. M. Lee, “Reproducibility of an intraoral scanner: a comparison between in-vivo and ex-vivo scans,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 154, no. 2, pp. 305–310, 2018.
- P. Gonzalez de Villaumbrosia, F. Martinez-Rus, A. Garcia-Orejas, M. P. Salido, and G. Pradíes, “In vitro comparison of the accuracy (trueness and precision) of six extraoral dental scanners with different scanning technologies,” The Journal of Prosthetic Dentistry, vol. 116, no. 4, pp. 543–550.e1, 2016.
- H. B. Jacob, G. D. Wyatt, and P. H. Buschang, “Reliability and validity of intraoral and extraoral scanners,” Progress in Orthodontics, vol. 16, no. 1, p. 38, 2015.
- J. Abduo and M. Elseyoufi, “Accuracy of intraoral scanners: a systematic review of influencing factors,” The European Journal of Prosthodontics and Restorative Dentistry, vol. 26, no. 3, pp. 101–121, 2018.
- F. S. Andriessen, D. R. Rijkens, W. J. van der Meer, and D. W. Wismeijer, “Applicability and accuracy of an intraoral scanner for scanning multiple implants in edentulous mandibles: a pilot study,” The Journal of Prosthetic Dentistry, vol. 111, no. 3, pp. 186–194, 2014.
- J. A. Burzynski, A. R. Firestone, F. M. Beck, H. W. Fields Jr., and T. Deguchi, “Comparison of digital intraoral scanners and alginate impressions: time and patient satisfaction,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 153, no. 4, pp. 534–541, 2018.
- K. E. Ahmed, T. Wang, K. Y. Li, W. K. Luk, and M. F. Burrow, “Performance and perception of dental students using three intraoral CAD/CAM scanners for full-arch scanning,” Journal of Prosthodontic Research, vol. 63, no. 2, pp. 167–172, 2019.
- T. F. Alghazzawi, “Advancements in CAD/CAM technology: options for practical implementation,” Journal of Prosthodontic Research, vol. 60, no. 2, pp. 72–84, 2016.
Copyright © 2020 Hong Xin Cai et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.