Table of Contents Author Guidelines Submit a Manuscript
Journal of Healthcare Engineering
Volume 2017 (2017), Article ID 3495723, 11 pages
https://doi.org/10.1155/2017/3495723
Research Article

Taxonomy-Based Approaches to Quality Assurance of Ontologies

1Informatics Department, New Jersey Institute of Technology, Newark, NJ 07102-1982, USA
2Computer Science Department, New Jersey Institute of Technology, Newark, NJ 07102-1982, USA

Correspondence should be addressed to Michael Halper

Received 7 May 2017; Accepted 6 August 2017; Published 11 October 2017

Academic Editor: Jiang Bian

Copyright © 2017 Michael Halper et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. O. Bodenreider, “Biomedical ontologies in action: role in knowledge management, data integration and decision support,” Yearbook of Medical Informatics, pp. 67–79, 2008. View at Google Scholar
  2. B. Smith and R. H. Scheuermann, “Ontologies for clinical and translational research: introduction,” Journal of Biomedical Informatics, vol. 44, no. 1, pp. 3–7, 2011. View at Publisher · View at Google Scholar · View at Scopus
  3. M. Ivanović and Z. Budimac, “An overview of ontologies and data resources in medical domains,” Expert Systems with Applications, vol. 41, no. 11, pp. 5158–5166, 2014. View at Publisher · View at Google Scholar · View at Scopus
  4. R. Hoehndorf, P. N. Schofield, and G. V. Gkoutos, “The role of ontologies in biological and biomedical research: a functional perspective,” Briefings in Bioinformatics, vol. 16, no. 6, pp. 1069–1080, 2015. View at Publisher · View at Google Scholar · View at Scopus
  5. B. M. Konopka, “Biomedical ontologies–a review,” Biocybernetics and Biomedical Engineering, vol. 35, no. 2, pp. 75–86, 2015. View at Publisher · View at Google Scholar · View at Scopus
  6. F. Shen and Y. Lee, “Knowledge discovery from biomedical ontologies in cross domains,” PLoS One, vol. 11, no. 8, article e0160005, 2016. View at Publisher · View at Google Scholar · View at Scopus
  7. X. Zhu, J.-W. Fan, D. M. Baorto, C. Weng, and J. J. Cimino, “A review of auditing methods applied to the content of controlled biomedical terminologies,” Journal of Biomedical Informatics, vol. 42, no. 3, pp. 413–425, 2009. View at Publisher · View at Google Scholar · View at Scopus
  8. J. E. Rogers, “Quality assurance of medical ontologies,” Methods of Information in Medicine, vol. 45, no. 3, pp. 267–274, 2006. View at Google Scholar
  9. “SNOMED International,” May 2017, http://www.snomed.org/snomed-ct.
  10. M. Q. Stearns, C. Price, K. A. Spackman, and A. Y. Wang, “SNOMED clinical terms: overview of the development process and project status,” in Proceedings 2001 AMIA Annual Symposium, S. Bakken, Ed., pp. 662–666, Washington, DC, USA, 2001.
  11. N. Sioutos, S. de Coronado, M. W. Haber, F. W. Hartel, W.-L. Shaiu, and L. W. Wright, “NCI thesaurus: a semantic model integrating cancer-related clinical and molecular information,” Journal of Biomedical Informatics, vol. 40, no. 1, pp. 30–43, 2007. View at Publisher · View at Google Scholar · View at Scopus
  12. G. Fragoso, S. de Coronado, M. Haber, F. W. Hartel, and L. Wright, “Overview and utilization of the NCI thesaurus,” Comparative and Functional Genomics, vol. 5, no. 8, pp. 648–654, 2004. View at Publisher · View at Google Scholar · View at Scopus
  13. “Gene Ontology Consortium,” May 2017, http://www.geneontology.org.
  14. Gene Ontology Consortium, “Creating the Gene Ontology resource: design and implementation,” Genome Research, vol. 11, pp. 1425–1433, 2001. View at Publisher · View at Google Scholar · View at Scopus
  15. O. Bodenreider, B. Smith, A. Kumar, and A. Burgun, “Investigating subsumption in SNOMED CT: an exploration into large description logic-based biomedical terminologies,” Artificial Intelligence in Medicine, vol. 39, no. 3, pp. 183–195, 2007. View at Publisher · View at Google Scholar · View at Scopus
  16. O. Bodenreider, A. Burgun, and T. C. Rindflesch, “Assessing the consistency of a biomedical terminology through lexical knowledge,” International Journal of Medical Informatics, vol. 67, no. 1–3, pp. 85–95, 2002. View at Publisher · View at Google Scholar · View at Scopus
  17. F. Mougin and O. Bodenreider, “Auditing the NCI thesaurus with semantic web technologies,” in Proceedings 2008 AMIA Annual Symposium, J. Suermondt, R. S. Evans, and L. Ohno-Machado, Eds., pp. 500–504, Washington, DC, USA, 2008.
  18. W. Ceusters, “Applying evolutionary terminology auditing to the Gene Ontology,” Journal of Biomedical Informatics, vol. 42, no. 3, pp. 518–529, 2009. View at Publisher · View at Google Scholar · View at Scopus
  19. Y. Wang, M. Halper, D. Wei et al., “Auditing complex concepts of SNOMED using a refined hierarchical abstraction network,” Journal of Biomedical Informatics, vol. 45, no. 1, pp. 1–14, 2012. View at Publisher · View at Google Scholar · View at Scopus
  20. “BioPortal,” May 2017, http://bioportal.bioontology.org/.
  21. P. L. Whetzel, N. F. Noy, N. H. Shah et al., “BioPortal: enhanced functionality via new web services from the National Center for Biomedical Ontology to access and use ontologies in software applications,” Nucleic Acids Research, vol. 39, Web server issue, pp. W541–W545, 2011. View at Publisher · View at Google Scholar · View at Scopus
  22. I. Sim, S. W. Tu, S. Carini et al., “The Ontology of Clinical Research (OCRe): an informatics foundation for the science of clinical research,” Journal of Biomedical Informatics, vol. 52, pp. 78–91, 2014. View at Publisher · View at Google Scholar · View at Scopus
  23. S. Arabandi, C. Ogbuji, S. Redline et al., “Developing a sleep domain ontology,” in Proceedings AMIA Clinical Research Informatics Summit, pp. 12-13, San Francisco, CA, USA, 2010.
  24. D. Zeginis, A. Hasnain, N. Loutas, H. F. Deus, R. Fox, and K. A. Tarabanis, “A collaborative methodology for developing a semantic model for interlinking cancer chemoprevention linked-data sources,” Semantic Web, vol. 5, no. 2, pp. 127–142, 2014. View at Google Scholar
  25. D. Qi, R. D. King, A. L. Hopkins, G. R. Bickerton, and L. N. Soldatova, “An ontology for description of drug discovery investigations,” Journal of Integrative Bioinformatics, vol. 7, no. 3, 2010. View at Publisher · View at Google Scholar
  26. C. Ochs, Z. He, L. Zheng et al., “Utilizing a structural metaontology for family-based quality assurance of the BioPortal ontologies,” Journal of Biomedical Informatics, vol. 61, pp. 63–76, 2016. View at Publisher · View at Google Scholar · View at Scopus
  27. Y. Wang, M. Halper, H. Min, Y. Perl, Y. Chen, and K. A. Spackman, “Structural methodologies for auditing SNOMED,” Journal of Biomedical Informatics, vol. 40, no. 5, pp. 561–581, 2007. View at Publisher · View at Google Scholar · View at Scopus
  28. M. Halper, Y. Wang, H. Min et al., “Analysis of error concentrations in SNOMED,” in Proceedings 2007 AMIA Annual Symposium, J. M. Teich, J. Suermondt, and G. Hripcsak, Eds., pp. 314–318, Chicago, IL, USA, 2007.
  29. H. Min, Y. Perl, Y. Chen, M. Halper, J. Geller, and Y. Wang, “Auditing as part of the terminology design life cycle,” Journal of the American Medical Informatics Association, vol. 13, no. 6, pp. 676–690, 2006. View at Publisher · View at Google Scholar · View at Scopus
  30. Y. Wang, M. Halper, D. Wei, Y. Perl, and J. Geller, “Abstraction of complex concepts with a refined partial-area taxonomy of SNOMED,” Journal of Biomedical Informatics, vol. 45, no. 1, pp. 15–29, 2012. View at Publisher · View at Google Scholar · View at Scopus
  31. C. Ochs, J. Geller, Y. Perl et al., “Scalable quality assurance for large SNOMED CT hierarchies using subject-based subtaxonomies,” Journal of the American Medical Informatics Association, vol. 22, no. 3, pp. 507–518, 2014. View at Publisher · View at Google Scholar · View at Scopus
  32. M. Halper, H. Gu, Y. Perl, and C. Ochs, “Abstraction networks for terminologies: supporting management of “big knowledge”,” Artificial Intelligence in Medicine, vol. 64, no. 1, pp. 1–16, 2015. View at Publisher · View at Google Scholar · View at Scopus
  33. “OWL web ontology language reference,” July 2017, https://www.w3.org/TR/owl-ref.
  34. B. Smith, M. Ashburner, C. Rosse et al., “The OBO foundry: coordinated evolution of ontologies to support biomedical data integration,” Nature Biotechnology, vol. 25, pp. 1251–1255, 2007. View at Publisher · View at Google Scholar · View at Scopus
  35. W. Ceusters, “SNOMED CT’s RF2: is the future bright?” Studies in Health Technology and Informatics, vol. 169, pp. 829–833, 2011. View at Google Scholar
  36. E. H. Granger, “Aristotle on genus and differentia,” Journal of the History of Philosophy, vol. 22, no. 1, pp. 1–23, 1984. View at Google Scholar
  37. H. Gu, J. J. Cimino, M. Halper, J. Geller, and Y. Perl, “Utilizing OODB schema modeling for vocabulary management,” in Proceedings 1996 AMIA Annual Fall Symposium, J. J. Cimino, Ed., pp. 274–278, Washington, DC, USA, 1996.
  38. H. Gu, Y. Perl, J. Geller, M. Halper, L. Liu, and J. J. Cimino, “Representing the UMLS as an OODB: modeling issues and advantages,” Journal of the American Medical Informatics Association, vol. 7, no. 1, pp. 66–80, 2000, selected for reprint in: R. Haux and C. Kulikowski, editors, Yearbook of Medical Informatics: Digital Libraries and Medicine (International Medical Informatics Association), pages 271–285, Schattauer, Stuttgart, Germany, 2001. View at Google Scholar
  39. J. J. Cimino, P. D. Clayton, G. Hripcsak, and S. B. Johnson, “Knowledge-based approaches to the maintenance of a large controlled medical terminology,” Journal of the American Medical Informatics Association, vol. 1, no. 1, pp. 35–50, 1994. View at Google Scholar
  40. “Unified Medical Language System (UMLS),” July 2017, https://www.nlm.nih.gov/research/umls.
  41. C. Ochs, J. Geller, Y. Perl, and M. A. Musen, “A unified software framework for deriving, visualizing, and exploring abstraction networks for ontologies,” Journal of Biomedical Informatics, vol. 62, pp. 90–105, 2016. View at Publisher · View at Google Scholar · View at Scopus
  42. “Protégé,” May 2017, http://protege.stanford.edu.
  43. P. I. Good, Permutation, Parametric, and Bootstrap Tests of Hypotheses: A Practical Guide to Resampling, Springer, New York, NY, USA, 3rd edition, 2005.
  44. H. Min, L. Zheng, Y. Perl, M. Halper, S. de Coronado, and C. Ochs, “Relating complexity and error rates of ontology concepts: more complex NCIt concepts have more errors,” Methods of Information in Medicine, vol. 56, no. 3, pp. 200–208, 2017. View at Publisher · View at Google Scholar
  45. “Chemical entities of biological interest (ChEBI),” January 2017, http://bioportal.bioontology.org/.
  46. K. Degtyarenko, P. de Matos, M. Ennis et al., “ChEBI: a database and ontology for chemical entities of biological interest,” Nucleic Acids Research, vol. 36, Database issue, pp. D344–D350, 2008. View at Publisher · View at Google Scholar · View at Scopus
  47. B. Efron and R. J. Tibshirani, An Introduction to the Bootstrap, CRC Press, Boca Raton, FL, USA, 1993.
  48. C. Ochs, Y. Perl, M. Halper, J. Geller, and J. Lomax, “Quality assurance of the Gene Ontology using abstraction networks,” Journal of Bioinformatics and Computational Biology, vol. 14, no. 3, 2016. View at Publisher · View at Google Scholar · View at Scopus
  49. C. J. Mungall, C. Torniai, G. V. Gkoutos, S. E. Lewis, and M. A. Haendel, “Uberon, an integrative multispecies anatomy ontology,” Genome Biology, vol. 13, article R5, 2012. View at Publisher · View at Google Scholar · View at Scopus
  50. G. Elhanan, C. Ochs, J. L. V. Mejino, H. Liu, and Y. Perl, “From SNOMED CT to Uberon: transferability of evaluation methodology between similarly structured ontologies,” Artificial Intelligence in Medicine, vol. 79, 2017. View at Publisher · View at Google Scholar
  51. C. Ochs, Y. Perl, J. Geller et al., “Scalability of abstraction-network-based quality assurance to large SNOMED hierarchies,” in Proceedings 2013 AMIA Annual Symposium, pp. 1071–1080, Washington, DC, USA, 2013.
  52. L. Zheng, H. Min, Y. Chen, J. Xu, J. Geller, and Y. Perl, “Auditing National Cancer Institute thesaurus neoplasm concepts in groups of high error concentration,” Applied Ontology, vol. 12, no. 2, pp. 113–130, 2017. View at Google Scholar
  53. D. Wei and O. Bodenreider, “Using the abstraction network in complement to description logics for quality assurance in biomedical terminologies - a case study in SNOMED-CT,” in Proceedings Medinfo 2010, pp. 1070–1074, Cape Town, South Africa, 2010.