Gai Elhanan1, Christopher Ochs2, Jose L V Mejino3, Hao Liu2, Christopher J Mungall4, Yehoshua Perl2. 1. Computer Science Department, New Jersey Institute of Technology, Newark, NJ, USA. Electronic address: gelhanan@gmail.com. 2. Computer Science Department, New Jersey Institute of Technology, Newark, NJ, USA. 3. Department of Biological Structure (Structural Informatics Group), University of Washington, Seattle, WA, USA. 4. Genomics Division, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA.
Abstract
OBJECTIVE: To examine whether disjoint partial-area taxonomy, a semantically-based evaluation methodology that has been successfully tested in SNOMED CT, will perform with similar effectiveness on Uberon, an anatomical ontology that belongs to a structurally similar family of ontologies as SNOMED CT. METHOD: A disjoint partial-area taxonomy was generated for Uberon. One hundred randomly selected test concepts that overlap between partial-areas were matched to a same size control sample of non-overlapping concepts. The samples were blindly inspected for non-critical issues and presumptive errors first by a general domain expert whose results were then confirmed or rejected by a highly experienced anatomical ontology domain expert. Reported issues were subsequently reviewed by Uberon's curators. RESULTS: Overlapping concepts in Uberon's disjoint partial-area taxonomy exhibited a significantly higher rate of all issues. Clear-cut presumptive errors trended similarly but did not reach statistical significance. A sub-analysis of overlapping concepts with three or more relationship types indicated a much higher rate of issues. CONCLUSIONS: Overlapping concepts from Uberon's disjoint abstraction network are quite likely (up to 28.9%) to exhibit issues. The results suggest that the methodology can transfer well between same family ontologies. Although Uberon exhibited relatively few overlapping concepts, the methodology can be combined with other semantic indicators to expand the process to other concepts within the ontology that will generate high yields of discovered issues.
OBJECTIVE: To examine whether disjoint partial-area taxonomy, a semantically-based evaluation methodology that has been successfully tested in SNOMED CT, will perform with similar effectiveness on Uberon, an anatomical ontology that belongs to a structurally similar family of ontologies as SNOMED CT. METHOD: A disjoint partial-area taxonomy was generated for Uberon. One hundred randomly selected test concepts that overlap between partial-areas were matched to a same size control sample of non-overlapping concepts. The samples were blindly inspected for non-critical issues and presumptive errors first by a general domain expert whose results were then confirmed or rejected by a highly experienced anatomical ontology domain expert. Reported issues were subsequently reviewed by Uberon's curators. RESULTS: Overlapping concepts in Uberon's disjoint partial-area taxonomy exhibited a significantly higher rate of all issues. Clear-cut presumptive errors trended similarly but did not reach statistical significance. A sub-analysis of overlapping concepts with three or more relationship types indicated a much higher rate of issues. CONCLUSIONS: Overlapping concepts from Uberon's disjoint abstraction network are quite likely (up to 28.9%) to exhibit issues. The results suggest that the methodology can transfer well between same family ontologies. Although Uberon exhibited relatively few overlapping concepts, the methodology can be combined with other semantic indicators to expand the process to other concepts within the ontology that will generate high yields of discovered issues.
Authors: Christopher Ochs; James Geller; Yehoshua Perl; Yan Chen; Junchuan Xu; Hua Min; James T Case; Zhi Wei Journal: J Am Med Inform Assoc Date: 2014-10-21 Impact factor: 4.497
Authors: Christopher Ochs; Zhe He; Ling Zheng; James Geller; Yehoshua Perl; George Hripcsak; Mark A Musen Journal: J Biomed Inform Date: 2016-03-14 Impact factor: 6.317
Authors: Yue Wang; Michael Halper; Duo Wei; Huanying Gu; Yehoshua Perl; Junchuan Xu; Gai Elhanan; Yan Chen; Kent A Spackman; James T Case; George Hripcsak Journal: J Biomed Inform Date: 2011-09-01 Impact factor: 6.317
Authors: Christopher J Mungall; Carlo Torniai; Georgios V Gkoutos; Suzanna E Lewis; Melissa A Haendel Journal: Genome Biol Date: 2012-01-31 Impact factor: 13.583