| Literature DB >> 31523480 |
Karin Lindman1, Jerómino F Rose2, Martin Lindvall3, Claes Lundström4, Darren Treanor1,5,6.
Abstract
OBJECTIVE: Digital pathology is today a widely used technology, and the digitalization of microscopic slides into whole slide images (WSIs) allows the use of machine learning algorithms as a tool in the diagnostic process. In recent years, "deep learning" algorithms for image analysis have been applied to digital pathology with great success. The training of these algorithms requires a large volume of high-quality images and image annotations. These large image collections are a potent source of information, and to use and share the information, standardization of the content through a consistent terminology is essential. The aim of this project was to develop a pilot dataset of exhaustive annotated WSI of normal and abnormal human tissue and link the annotations to appropriate ontological information.Entities:
Keywords: Annotation; digital pathology; image database; ontology; whole slide images
Year: 2019 PMID: 31523480 PMCID: PMC6669998 DOI: 10.4103/jpi.jpi_81_18
Source DB: PubMed Journal: J Pathol Inform
Figure 1Workstation. The complexity of the annotation process and workflow required an adequate and ergonomic workstation, which was composed of several tools, including a high-resolution screen, high-resolution touch screen, precision pen, computer, ergonomic mouse, keyboard, chair, and table. The height of the table and the chair were able to be adjusted to the proportions of the person doing the annotations
Figure 2Annotated whole slide images from the colon. The annotations were done focusing on different subcompartments found in the colon, as well as pointing out abnormalities if present
Figure 3Annotated whole slide images from the skin. The annotations were done focusing on different subcompartments found in the skin, as well as pointing out abnormalities if present. When comparing the annotations from colon and skin whole slide images, the skin annotations were more complicated to perform
Summary of pros and cons of each ontology
| Ontology | Pros | Cons |
|---|---|---|
| NCIt | Well-known and evolving reference terminology/biomedical ontology | Not a formal ontology |
| FMA | Well-known and evolving reference ontology | No coverage for disease, terms as abnormal, normal, or artifact |
| MeSH | Well-known and evolving vocabulary thesaurus | No ontology |
| SNOMED CT | Well-known and evolving hierarchy of concepts/ontology | Low formality |
SNOMED CT: Standardized nomenclature of medicine clinical terms, MeSH: Medical subject headings, FMA: Foundational model of anatomy, NCIt: National Cancer Institute thesaurus
Figure 4Image branch of the body structure hierarchy in systemized nomenclature of medicine clinical terms (SNOMED CT) including the systemized nomenclature of medicine-clinical terms’ codes. The different structures and diagnoses are ordered in a structured way, originating from the “body structure” concept
Summary of results
| Result type | Value |
|---|---|
| Total number of WSIs | 200 |
| Normal WSIs | 99 |
| Abnormal WSIs | 101 |
| Total number of SNOMED CT codes | 95 |
| Anatomical locations | 37 |
| Subcompartments | 10 |
| Specific abnormality codes | 44 |
| Total number of annotations | 17497 |
| Total area annotated | 302.19 cm2 127.7 GP |
| Total time taken to annotate | 360 h (approximately) |
SNOMED CT: Standardized nomenclature of medicine clinical terms, WSI: Whole slide images
| SNOMED CT concept | Code |
|---|---|
| Abnormal | 263654008 |
| Acute and chronic inflammation | 75889009 |
| Acute inflammation | 4532008 |
| Adenocarcinoma | 35917007 |
| Artifact | 47973001 |
| Ascending colon | 9040008 |
| Atrophy | 13331008 |
| Cecum | 32713005 |
| Chronic inflammation | 84499006 |
| Colon | 71854001 |
| Colonic mucous membrane | 68502009 |
| Colonic muscularis propria | 41948009 |
| Colonic submucosa | 61647009 |
| Colonic subserosa | 52010009 |
| Descending colon | 32622004 |
| Diverticula | 31113003 |
| Diverticulitis | 18126004 |
| Dysplasia | 25723000 |
| Edema | 79654002 |
| Fibrosis | 112674009 |
| Granulation tissue | 61363009 |
| Hemorrhage | 50960005 |
| Hyalinization | 19010006 |
| Hyperplasia | 76197007 |
| Hyperplastic polyp | 62047007 |
| Ileum | 34516001 |
| Inflammation | 23583003 |
| Lymphoma | 21964009 |
| Mucinous adenocarcinoma | 72495009 |
| Necrosis | 6574001 |
| Normal | 17621005 |
| Rectum | 34402009 |
| Serrated adenoma | 128653004 |
| Sigmoid colon | 60184004 |
| Stasis | 19685008 |
| Transverse colon | 485005 |
| Tubular adenoma | 444408007 |
| Tubulovillous adenoma | 61722000 |
| Ulcer | 56208002 |
SNOMED CT: Standardized nomenclature of medicine clinical terms
Number of cases from different parts of colon or colon as a whole and corresponding standardized nomenclature of medicine clinical terms code
| Part of colon | Number of cases | SNOMED CT code |
|---|---|---|
| Right colon | 16 | 51342009 |
| Transverse colon | 3 | 485005 |
| Left colon | 7 | 55572008 |
| Sigmoid colon | 18 | 60184004 |
| Rectum | 2 | 34402009 |
| Colon unspecified | 4 | 71854001 |
SNOMED CT: Standardized nomenclature of medicine clinical terms
Number of different diagnoses and corresponding standardized nomenclature of medicine clinical terms code
| Diagnosis | Number of cases | SNOMED CT code |
|---|---|---|
| High-grade adenocarcinoma | 15 | 413447005 |
| Low-grade adenocarcinoma | 14 | 413449008 |
| Mucinous adenocarcinoma | 5 | 72495009 |
| Lymphoma | 1 | 21964009 |
| Tubulovillous adenoma | 1 | 61722000 |
| Tubular adenoma | 2 | 19665009 |
| Serrated adenoma | 2 | 128653004 |
| Ulcerative colitis | 1 | 64766004 |
| Morbus crohn | 1 | 34000006 |
| Hyperplastic polyp | 2 | 62047007 |
| Hyperplasia | 1 | 76197007 |
| Diverticulosis | 6 | 397881000 |
| Necrosis | 1 | 6574001 |
| Ulceration/hemorrhage | 1 | 56208002/50960005 |
| Inflammation | 1 | 23583003 |
SNOMED-CT: Standardized nomenclature of medicine clinical terms
| SNOMED CT concept | Code |
|---|---|
| Acanthosis | 23620008 |
| Actinic keratosis | 856006 |
| Basal cell carcinoma | 1338007 |
| Dermatofibroma | 72079004 |
| Dermis | 53534000 |
| Dysplastic nevus | 61814002 |
| Epidermis | 55988001 |
| Fibrosis | 112674009 |
| Fibrin body | 45619005 |
| Granuloma | 45647009 |
| Inflammation | 23583003 |
| Inflammatory edema | 103619005 |
| Intradermal nevus | 112681002 |
| Keratoacanthoma | 416378000 |
| Lentigo maligna melanoma | 44474009 |
| Malignant melanoma | 2092003 |
| Melanocytic nevus | 400101001 |
| Malignant melanoma | 77986002 |
| Normal skin | 225544001 |
| Perichondrium | 11881003 |
| Reactive cellular changes | 125513006 |
| Scar | 12402003 |
| Seborrheic keratosis | 25499005 |
| Skin and subcutaneous tissue structure | 127856007 |
| Skin and subcutaneous tissue structure of back | 417286006 |
| Skin and subcutaneous tissue structure of head | 389074000 |
| Skin and subcutaneous tissue structure of trunk | 389072001 |
| Skin appendage structure | 7748002 |
| Skin structure | 39937001 |
| Skin structure of back | 66643007 |
| Skin structure of breast | 82038008 |
| Skin structure of calf of leg | 51059006 |
| Skin structure of cheek | 36141000 |
| Skin structure of ear | 1902009 |
| Skin structure of eyebrow | 367577003 |
| Skin structure of eyelid and periocular area | 399996007 |
| Skin structure of face | 73897004 |
| Skin structure of female genitalia | 19938000 |
| Skin structure of forehead | 68698007 |
| Skin structure of foot | 60496002 |
| Skin structure of hand | 33712006 |
| Skin structure of head | 70762009 |
| Skin structure of lip | 88089004 |
| Skin structure of lower extremity | 371304004 |
| Skin structure of neck | 43081002 |
| Skin structure of nose | 113179006 |
| Skin structure of scalp | 43067004 |
| Skin structure of scapular region of back | 45980000 |
| Skin structure of shoulder | 76552005 |
| Skin structure of temple | 244081009 |
| Skin structure of thigh | 371305003 |
| Skin structure of upper extremity | 371311000 |
| Structure of cartilage of auditory canal | 83543000 |
| Squamous cell carcinoma | 28899001 |
| Squamous cell carcinoma | 59529006 |
| Subcutaneous fatty tissue | 67769002 |
| Subcutaneous tissue | 71966008 |
| Surgical margins | 82868003 |
SNOMED CT: Standardized nomenclature of medicine clinical terms
Number of cases from different skin parts and corresponding standardized nomenclature of medicine clinical terms code
| Part of skin | Number of cases | SNOMED CT code |
|---|---|---|
| Back | 5 | 66643007 |
| Head | 4 | 70762009 |
| Trunk | 3 | 389072001 |
| Breast | 2 | 82038008 |
| Calf of leg | 1 | 51059006 |
| Cheek | 6 | 36141000 |
| Ear | 9 | 1902009 |
| Eyebrow | 1 | 367577003 |
| Eyelid and periocular area | 3 | 399996007 |
| Face | 5 | 73897004 |
| Female genitalia | 1 | 19938000 |
| Forehead | 2 | 68698007 |
| Foot | 1 | 60496002 |
| Hand | 1 | 33712006 |
| Lip | 2 | 88089004 |
| Lower extremity | 6 | 371304004 |
| Neck | 2 | 43081002 |
| Nose | 6 | 113179006 |
| Scapular region of the back | 1 | 45980000 |
| Shoulder | 3 | 76552005 |
| Temple | 5 | 244081009 |
| Thigh | 2 | 371305003 |
| Upper extremity | 4 | 371311000 |
SNOMED CT: Standardized nomenclature of medicine clinical terms
Number of different diagnoses in the skin cases and corresponding standardized nomenclature of medicine clinical terms code
| Diagnosis | Number of cases | SNOMED CT code |
|---|---|---|
| Actinic keratosis | 1 | 856006 |
| Basal cell carcinoma | 31 | 1338007 |
| Dermatofibroma | 2 | 72079004 |
| Dysplastic nevus | 1 | 61814002 |
| Intradermalt nevus | 2 | 112681002 |
| Keratoacanthoma | 1 | 416378000 |
| Lentigo maligna melanoma | 1 | 44474009 |
| Malignant melanoma | 3 | 2092003 |
| Malignant melanoma | 1 | 77986002 |
| Scar | 3 | 12402003 |
| Seborrheic keratosis | 2 | 25499005 |
| Squamous cell carcinoma | 3 | 28899001 |
| Squamous cell carcinoma | 3 | 59529006 |
SNOMED CT: Standardized nomenclature of medicine clinical terms