Literature DB >> 32935127

Formal representation of patients' care context data: the path to improving the electronic health record.

Tiago K Colicchio1, Pavithra I Dissanayake1, James J Cimino1.   

Abstract

OBJECTIVE: To develop a collection of concept-relationship-concept tuples to formally represent patients' care context data to inform electronic health record (EHR) development.
MATERIALS AND METHODS: We reviewed semantic relationships reported in the literature and developed a manual annotation schema. We used the initial schema to annotate sentences extracted from narrative note sections of cardiology, urology, and ear, nose, and throat (ENT) notes. We audio recorded ENT visits and annotated their parsed transcripts. We combined the results of each annotation into a consolidated set of concept-relationship-concept tuples. We then compared the tuples used within and across the multiple data sources.
RESULTS: We annotated a total of 626 sentences. Starting with 8 relationships from the literature, we annotated 182 sentences from 8 inpatient consult notes (initial set of tuples = 43). Next, we annotated 232 sentences from 10 outpatient visit notes (enhanced set of tuples = 75). Then, we annotated 212 sentences from transcripts of 5 outpatient visits (final set of tuples = 82). The tuples from the visit transcripts covered 103 (74%) concepts documented in the notes of their respective visits. There were 20 (24%) tuples used across all data sources, 10 (12%) used only in inpatient notes, 15 (18%) used only in visit notes, and 7 (9%) used only in the visit transcripts.
CONCLUSIONS: We produced a robust set of 82 tuples useful to represent patients' care context data. We propose several applications of our tuples to improve EHR navigation, data entry, learning health systems, and decision support.
© The Author(s) 2020. Published by Oxford University Press on behalf of the American Medical Informatics Association.

Entities:  

Keywords:  clinical concepts; clinical decision support; clinical documentation; electronic health records; knowledge representation

Mesh:

Year:  2020        PMID: 32935127      PMCID: PMC7671623          DOI: 10.1093/jamia/ocaa134

Source DB:  PubMed          Journal:  J Am Med Inform Assoc        ISSN: 1067-5027            Impact factor:   4.497


Introduction

The US health system has recently achieved nationwide electronic health record (EHR) adoption, with large-scale adoption of commercial systems. These systems were adopted without a much-needed redesign, to address critical limitations, such as suboptimal interfaces,, overzealous alerts, and bloated notes; as a result, unintended consequences have emerged at different levels of the US health system. Recently proposed solutions to address EHRs’ limitations include improvements to EHR design and interoperability, clinical decision support (CDS), and transferring some data entry to patients., Others suggest that such improvements, if implemented in isolation, may not be sufficient because the EHR would still miss relevant information that is buried in clinical notes or the clinicians’ minds., The missing information is what we define as the patient’s care context data. The patient’s care context can refer to information about his/her health and care (eg, a patient reports that a symptom is getting worse) or the clinician’s interpretations and decisions (eg, current regimen was discontinued because the patient failed antibiotics). An EHR’s inability to represent such information is due, in part, to the fact that the problem-oriented structure of most EHRs does not require explicit statements about care decisions, or what Cimino defines as the “why” in the EHR. For example, a treatment can be linked to a problem, indicating that it was chosen to treat the problem, but the underlying reason behind this decision (eg, “why” this particular treatment was chosen) is not captured. We believe that if such information was routinely captured (in computable form, as well as modeled, structured, and coded), it could be used to inform better navigation, CDS, and data entry. We hypothesize that a formalism with linkages among clinical concepts, or semantic relationships, would be useful to represent patients’ care contexts as a semantic network of subject-predicate-object tuples. For instance, the inference “the patient’s mastoiditis is from her recurrent ear infection” could be represented with a formalism containing a subject (ear infection), a predicate (suggest_finding), and an object (mastoiditis). By creating such a tuple and adding the corresponding classifications (eg, ear infection = condition), coding (eg, Systematized Nomenclature of Medicine-Clinical Terms [SNOMED CT] ID: 129127001), and modifiers (eg, frequency = recurrent), one could formally represent a clinician’s interpretation about a patient’s finding, allowing the EHR to use this information for multiple purposes. We have conducted preliminary work to identify those relationships relevant for creating such tuples. We initially conducted a systematic review to explore how EHRs are used to support documentation of clinicians’ reasoning; we found that they provide virtually no automation to support this task, and rely on clinicians’ conscious decisions to document patients’ care context data in their notes. We then identified an initial sample of relationships from clinical cases published in the literature. Next, we conducted another systematic review to identify ontology properties (eg, concepts, relationships) from CDS systems that incorporate a formal ontology in their logic, and found that although most published ontologies contain relationships useful for CDS, they do not always provide relationships suitable for representing patients’ care context. In this study, we expand our sample of relationships, by manually annotating patients’ care context data as represented in clinical notes and spoken communications during outpatient visits.

Objective

Our objective was to develop a collection of concept-relationship-concept tuples to formally represent patients’ care context data to inform future research and EHR development.

MATERIALS AND METHODS

We conducted a multi-method study including the following steps: (1) identify an initial set of relationships from our prior work;, (2) annotate inpatient consult notes; (3) annotate outpatient visit notes; (4) annotate spoken communications during outpatient visits and verify whether the tuples from this annotation contain information communicated in the respective notes of these visits; and (5) compare the tuples used across the multiple data sources. These steps are described in detail in the subsequent sections. Figure 1 illustrates the multi-method approach. The University of Alabama-Birmingham (UAB) Institutional Review Board approved the study.
Figure 1.

Flowchart illustrating the multi-method approach.

Flowchart illustrating the multi-method approach.

Step 1: identification of relationships from the literature

The 3 authors independently reviewed the 163 relationships from our previous studies,, then met in person to reach consensus about an initial sample of relationships that seemed most likely, in our experience, to be useful for representing patients’ care context data as reported in clinical notes. We also reached consensus on the class (ie, the classification of a concept as finding, condition, intervention, etc.) of the subject concepts most likely to be associated with these relationships. The initial sample of concepts and relationships was used to start the annotation of inpatient consult notes (Step 2).

Step 2: annotation of inpatient consult notes

We extracted data from 2 note sections—history of present illness (HPI) and assessment and plan (AP)—from inpatient cardiology consult notes written between 1 August 2018 and 31 October 2018 at the UAB Hospital. We choose these sections because they contain the expressivity of patients’ care context, which is not typically found in more structured sections, such as “medication list” or “laboratory results.” We decided to start the annotations with consult notes because they are more likely to contain explicit contextual statements, as they reflect specialists’ interpretations and recommendations. We chose the specialty of cardiology because it is commonly referred by attending physicians. Annotations were conducted in rounds that included 35 sentences extracted from the HPI and AP sections of an initial random sample of 3 notes. We created a structured form for the annotations. First, 1 of the authors (TKC) removed all identifiable information from the content of HPI and AP sections of the selected notes and parsed the content into individual sentences. For each sentence, 2 authors (TKC, JJC) iteratively identified relevant text mentions (hereafter called concepts) to form concept pairs consisting of a subject concept (ie, the first concept in a tuple) and an object concept (ie, the second concept in tuple), along with their classes (eg, intervention, finding), with disagreements resolved via consensus. When a sentence contained more than 1 concept pair, it was repeated as many times as needed. Figure 2 provides an example of the structured form.
Figure 2.

Structured form used in the annotations. Note that the sentence in row 13 is repeated in row 14 because it contains multiple concept pairs. PHI: protected health information. CAD: Coronary Artery Disease; HF: Heart Failure; ICD: implantable cardioverter-defibrillator; RCC: renal cell carcinoma.

Structured form used in the annotations. Note that the sentence in row 13 is repeated in row 14 because it contains multiple concept pairs. PHI: protected health information. CAD: Coronary Artery Disease; HF: Heart Failure; ICD: implantable cardioverter-defibrillator; RCC: renal cell carcinoma. All authors independently annotated the concept pairs by filling out the column “Relationship” in the structured form using the relationships from Step 1. The parsed sentences were used to provide context. Subject classes were used to restrict the relationships that can be selected by only allowing the use of relationships associated with the subject class of each row (see example in Figure 1). When the relationships from Step 1 were deemed inappropriate, the column Relationship was left blank. After completing the annotation of the first round, we calculated inter-rater agreement using a Fleiss Kappa. The authors then met in person to discuss disagreements and identify new relationships and classes not covered by the original sample (Step 1). We searched for equivalent relationships and classes in our previous studies, to use them in the next round. For those not found, we created new relationships/classes via consensus. Subsequent rounds were conducted with the updated list of relationships and classes from the previous round, with the inter-rater agreement recalculated. New notes were added to the annotations until we reached saturation by annotating all concept pairs of a new round using only relationships from the previous round. These annotations resulted in an initial set of concept-relationship-concept tuples. Since a similar annotation schema is not available in the literature to serve as a model framework, we iteratively created our own guidelines for concept classification and relationship creation and use. Concepts more likely to have an equivalent term in standard vocabularies were generally classified as a finding, condition, intervention, or diagnostic process; when applicable, the Unified Medical Language System (UMLS) was consulted for this task. For other text mentions that provide contextual elements, we iteratively created new classes to classify them (eg, reason: “current regimen discontinued because patient failed antibiotics”). Relationships were created and used to indicate how 2 concepts are related (eg, patient-has_intervention-intervention). Patients and clinicians were treated as entities and had their own classes (ie, patient, clinician). Due to the conceptual, foundational stage of our schema, some restrictions were applied to facilitate the creation of a starter set of tuples: (1) normalization to standard vocabularies was out of the scope at this stage; (2) possible modifiers were directly added to the relationships (eg, negation: “has_absence_of_intervention”); and (3) concept classes were restricted to high-level classes (eg, pharmacotherapy, visit, and diet were all classified as “intervention”). The final version of the guidelines used in the annotation process can be found in the Supplementary Material.

Step 3: annotation of outpatient visit notes

To expand the initial set of tuples, we annotated clinical notes written from outpatient urology and ear, nose, and throat (ENT) specialty visits between 1 March 2019 and 30 June 2019 at the UAB specialty care clinic. We chose secondary specialties (urology and ENT) to contrast with the inpatient specialty from Step 2 (cardiology), thus allowing for an assessment of the applicability of tuples across heterogeneous specialties. The specialties chosen provide a wide range of concepts ranging from common infections to complex surgeries, thus increasing their generalizability. We used the same process from Step 2 to create a structured form. If we achieved a satisfactory agreement in Step 2 (agreement > 80% and K > .80), annotations were conducted by a single author (TKC) with the other authors consulted as needed; otherwise, they were conducted in rounds as in Step 2. The number of notes for this step was defined based on the number of notes needed to reach saturation in Step 2.

Step 4: annotation of patient-physician spoken communications

To expand our set of tuples and verify its usefulness to represent data from multiple data sources, we annotated transcripts of patient-physician spoken communications during 5 outpatient visits of 1 specialty from Step 3 (ENT). Upon physician and patient consent, we used a HIPAA-compliant audio recorder to record the entire visit. We transcribed the recordings verbatim, removing any identifiable information and labeling each speaker (eg, Speaker 1, Speaker 2). We used the same methods from previous steps to produce a structure form for annotations. Since spoken communications during clinical visits often involve informal conversations (eg, “hi, my name is ZZZ”) and explanations generally not documented in the EHR (eg, clinician explaining to the patient the chemical structure of a cauterizer), we only annotated sentences containing clinical concepts (eg, orders planned, symptoms reported) and their context (eg, course of findings, reason for ordering a medication), because they are more likely to be reported in clinical notes. Annotations followed the same methods from Step 3 (independent annotation by all authors [if no satisfactory agreement was reached in Step 2] or annotation by a single author [TKC; if satisfactory agreement was reached]). The combination of tuples from Steps 2, 3, and 4 formed our final set of tuples. After annotating the transcripts, we obtained the content of HPI and AP sections of the original visit notes. One of the authors (TKC) parsed the content into individual sentences and compared the concepts in each sentence against the content represented in the tuples used in the annotation of the transcripts. We verified whether these tuples would be useful to represent information documented in visit notes.

Step 5: comparison of the tuples used across the different data sources

Once we produced the combined list of tuples from Steps 2, 3, and 4, we compared the usage of tuples across the different data sources (inpatient consult notes, outpatient visit notes, and visit transcripts) to identify the tuples more commonly used within and across these sources.

RESULTS

We annotated 626 sentences; of these, 414 were extracted from 18 clinical notes and 212 from 5 visit transcripts. Starting with an initial sample of 8 relationships (Step 1), we annotated 182 sentences from 8 cardiology consult notes (Step 2), producing an initial set of concept-relationship-concept tuples (n = 43). We annotated 232 sentences from 10 outpatient visit notes (Step 3), producing an enhanced set of tuples (n = 75). Next, we parsed the transcripts of 5 ENT visits into 212 sentences that were annotated to produce a final set of tuples (n = 82; Step 4). We compared the tuples used to annotate the transcripts against the parsed sentences from their original visit notes (Step 4) and compared the usage of tuples across the different data sources (Step 5). After independently reviewing the 163 relationships from our previous studies,, the 3 authors iteratively formulated an initial sample of 8 relationships (Table 1).
Table 1.

Initial sample of 8 relationships used to start the annotations

IDSubject classSemantic relationshipDescriptionExample
1Patient

has_finding/

conditiona

Statement indicating that the patient has present symptom, sign, or conditionThe patient reported sore throat
2Patienthas_historyStatement of fact about a patient that constitutes past medical historyThe patient underwent 2 kidney transplants (2002, 2012)
3Finding/condition

suggest_finding/

condition

Statement inferring that a finding/condition suggests another finding/conditionThe pink sputum suggests hemoptysis
4Finding/conditionhas_interventionIntervention is initiated/executed to treat a present/presumed conditionLevofloxacin was ordered for his pneumonia
5Finding/condition

has_intention_of_

intervention

Description of the intention to treat a present/presumed conditionEncourage fluid intake
6Finding/conditionhas_courseThe course of a finding/conditionHer shortness of breath is becoming worse
7Interventionhas_reasonJustification/reason for ordering an interventionShe was placed on linezolid and Zosyn based on susceptibilities
8Interventionhas_effectIntervention has effect on patient’s finding/conditionPatient reported that the prednisone is working to decrease her pain

Note:  aWe were not able to find an unequivocal distinction between a finding and a condition and decided to merge them.

Initial sample of 8 relationships used to start the annotations has_finding/ conditiona suggest_finding/ condition has_intention_of_ intervention Note:  aWe were not able to find an unequivocal distinction between a finding and a condition and decided to merge them. During the annotation of inpatient consult notes 8 notes were used, which reached saturation in the fifth round after 182 sentences had been annotated with 43 unique tuples. In the first round, inter-rater agreement was moderately low (57% agreement, K = .44), and most disagreements were caused by unclear definitions and uses of the relationships from Step 1. These were resolved via consensus and the agreement of the subsequent rounds was consistently better (round 2: 88% agreement, K = .85; round 3: 83% agreement, K = .81; round 4: 82% agreement, K = .80; and round 5: 86% agreement, K = .84). The partial remaining disagreements were resolved via consensus and were mostly due to final adjustments applied to some classes and relationships. The complete list of sentences annotated in Step 2 can be found in Supplementary Table S1. With the satisfactory agreement achieved in Step 2, we proceeded with the annotations of outpatient visit notes conducted primarily by 1 author (TKC). Since saturation in Step 2 was achieved with 8 notes, we decided to use 10 visit notes (5 urology and 5 ENT notes). The content from the HPI and AP sections of the 10 notes produced 232 sentences that were annotated with 59 tuples; of these, 27 (46%) were identified in Step 2 and 32 (54%) were identified in Step 3. The combination of tuples from Steps 2 and 3 produced an enhanced set of tuples (n = 75). The complete list of sentences annotated in Step 3 can be found in Supplementary Table S2. The audio recordings of 5 ENT visits were transcribed and parsed into 212 sentences. Note: in some cases, responses to clinicians’ questions (eg, [Speaker 1]: Are you on blood thinners? [Speaker 2]: No.) were combined with their preceding question into a single sentence to facilitate the annotations. The 212 sentences were annotated with 50 tuples; of these, 43 (86%) were identified in the previous steps and 7 (14%) in this step. The combination of tuples from Steps 2, 3, and 4 produced a final list of 82 unique tuples, combining 48 relationships and 14 concept classes. Table 2 lists the top 15 most used relationships and their subject and object classes. Figure 3 illustrates the connections produced by the top 15 most used relationships. The complete list of sentences annotated in Step 4 and the complete list of relationships and their concept classes can be found in Supplementary Tables S3 and S4.
Table 2.

The top 15 most used relationships and their subject and object classes

#Subject class(es)RelationshipObject class(es)DescriptionExampleSource
81

Finding/condition

Patient

has_intervention

Intervention

Diagnostic process

Intervention is initiated/executed to treat a present/presumed finding/conditionThe patient began to receive levofloxacin to treat his pneumoniaPrior work17,18
71

Finding site

Patient

has_finding/conditionFinding/conditionStatement indicating that the patient or a specific finding site has a finding/conditionThe patient reported sore throat and his physical indicated swollen lymph nodesPrior work18
69

Finding/condition

Patient

has_intention_of_interventionInterventionStatement indicating the intention to perform an interventionAvoid dehydration—encourage fluid intakePrior work17
49

Diagnostic process

Intervention

has_reason

Finding/condition

Intervention

Reason

Justification/reason for ordering a procedure or interventionShe was placed on linezolid and Zosyn based on susceptibilitiesPrior work18
36

Diagnostic process

Documentation

Finding/condition

Intervention

suggest_finding/conditionFinding/conditionFinding/condition suggested by a diagnostic process, documentation, finding/condition, or interventionThe pink sputum suggests hemoptysisPrior work17,18
32

Diagnostic process

Finding/condition

Intervention

has_dateTimeInference about the time when an event has happened or will happenShe has an appointment with Dr. PHI tomorrowPrior work18
27Patienthas_history

Finding/condition

Intervention

Statement about a patient that constitutes past medical historyThe patient underwent 2 kidney transplants (2002, 2012)Prior work17,18
20Interventionhas_effectFinding/conditionStatement about the effect of an interventionPatient reported that the prednisone is working to decrease her painPrior work18
17

Intervention

Task

has_trigger

Finding/condition

Reason

Statement indicating that an intervention or task will be triggered by an eventPlease call if we can be of further assistanceStep 2
16Patienthas_absence_of_finding/conditionFinding/conditionStatement indicating absence of finding/conditionShe is not symptomaticStep 2
16Patienthas_visit_reason

Finding/condition

Intervention

Reason for an outpatient visitPatient returns for packing and splint removalStep 3
12

Finding/condition

Intervention

has_frequencyTimeStatement indicating the frequency of a finding/condition or interventionThe nosebleeds have become dailyStep 4
12Patient

has_intention_of_diagnostic_

procedure

Diagnostic processStatement indicating the intention to perform a diagnostic procedureObtain fluid culturesStep 2
11Finding/conditionhas_courseCourseThe course of a finding/conditionHer shortness of breath is becoming worsePrior work18
8Finding/conditioncan_cause_finding/conditionFinding/conditionStatement of medical knowledge about the potential cause of a finding/conditionIf systemic release of toxins occurs, a diffuse pustular variant of the toxic shock syndrome can also occurPrior work17,18

Note: Relationships are sorted by descending order of tuples in which they were used (column #). The Source column denotes the source of the relationship used during the annotations (ie, if it was found in our previous studies or had to be created via consensus).

PHI: protected health information.

Figure 3.

Connections produced by the top 15 most used relationships. The line thickness indicates frequency of use, ranging from 8 to 81.

The top 15 most used relationships and their subject and object classes Finding/condition Patient Intervention Diagnostic process Finding site Patient Finding/condition Patient Diagnostic process Intervention Finding/condition Intervention Reason Diagnostic process Documentation Finding/condition Intervention Diagnostic process Finding/condition Intervention Finding/condition Intervention Intervention Task Finding/condition Reason Finding/condition Intervention Finding/condition Intervention has_intention_of_diagnostic_ procedure Note: Relationships are sorted by descending order of tuples in which they were used (column #). The Source column denotes the source of the relationship used during the annotations (ie, if it was found in our previous studies or had to be created via consensus). PHI: protected health information. Connections produced by the top 15 most used relationships. The line thickness indicates frequency of use, ranging from 8 to 81. The visit transcripts had, on average, 1516 words, of which 176 (13%) were classified as informal conversations, 573 (39%) were classified as general explanations, and 740 (45%) formed the sentences included in the annotations. We also identified a small portion of questions that were answered with non-verbal communication (eg, nodding, gesture); these were classified as unclear communication and were excluded from the annotations. Table 3 summarizes the audio recordings and visit transcripts.
Table 3.

Summarization of the audio recordings and visit transcripts

VisitTimeWords, TotalInformal Conversation, n (%)General Explanations, n (%)Unclear Communication, n (%)Annotated, n (%)
Visit 1161481110 (7%)652 (44%)82 (6%)637 (43%)
Visit 256465 (0.8%)403 (62%)0 (0%)238 (37%)
Visit 3232115140 (7%)1023 (48%)40 (2%)912 (43%)
Visit 4141149551 (48%)187 (16%)0 (0%)411 (36%)
Visit 524218874 (3%)601 (27%)11 (1%)1502 (69%)
Average16.41515.8176 (13%)573 (39%)27 (2%)740 (45%)

Note: The Time column denotes the time in minutes of an active conversation between a clinician and the patient or a family member.

Summarization of the audio recordings and visit transcripts Note: The Time column denotes the time in minutes of an active conversation between a clinician and the patient or a family member. We parsed the content of the HPI and AP sections of the original notes of the recorded visits into 140 sentences; of these, 103 (74%) contained concepts that had been included in the transcript tuples, 36 were not covered by the tuples, and 1 was inconsistent with what was represented in the tuples. We reviewed the 36 sentences not covered by the tuples and iteratively classified them as “reasoning not verbalized” (ie, clinician did not mention an interpretation added to the note) or “medical record information” (ie, information from the patient’s record was not verbalized, but was documented in the note). There were 27 sentences classified as reasoning not verbalized; examples include reasons for performing an assessment (“based on patient’s symptoms we performed a nasal endoscopy”) and perceptions about a patient’s comprehension (“barriers to learning: none evident”). There were 9 sentences classified as medical record information (eg, “complete blood count obtained and hemoglobin/hematocrit—8/26”). We found 2 tuples with information communicated during the visit (eg, “[Speaker 1]: Do you feel any pressure? [Speaker 2]: Yes, on my head”) but not documented in the notes (eg, “patient denies pressure”). Figure 4 provides examples of sentences with concepts covered by the tuples. The complete comparison of transcript tuples and note sentences can be found in Supplementary Table S5.
Figure 4.

Examples of note sentences covered by the transcript tuples. PHI: protected health information.

Examples of note sentences covered by the transcript tuples. PHI: protected health information. From the 82 tuples in our final set, 20 (24%) were used across all data sources, with the most common being a finding/condition reported by the patient (“I had a really bad nosebleed”), followed by the intention to start an intervention (“recommend beginning IV [intravenous] steroids”). There were 10 (12%) tuples used only in Step 2, which included mostly assessments and recommendations by a specialist. The most common were the absence of improvement of an intervention (“diuresis had no improvement in crackles”) and eligibility for an intervention (“he is not a heart failure candidate for transplant”). There were 15 (18%) tuples used only in Step 3, with the most common being the reason for the visit (“patient presents today with urinary incontinence”), followed by a diagnostic process not suggesting a finding/condition (“cystogram showed no leakage”). There were 7 (9%) tuples used only in Step 4, with the most common being the frequency of an intervention (“nasal rinse 3 times a day”), followed by the date of a finding/condition (“last night I had another nosebleed”). Table 4 lists the top 5 used tuples of each data source and across all data sources, and Figure 5 illustrates the distribution of tuples used within and across all sources. The complete list of tuples used can be found in Supplementary Table S6.
Table 4.

Top 5 tuples in each data source and top 5 tuples used in all data sources

Subject classRelationshipObject classStep 2Step 3Step 4
Tuples used only in inpatient consult notes
 Interventionhas_absence_of_improvementFinding/condition6
 Patientis_not_eligibleIntervention5
 Patientis_admittedSetting/location3
 Interventionhas_abandonment_reasonFinding/condition2
 Clinicianhas_actionTask2
Tuples used only in outpatient visit notes
 Patienthas_visit_reasonIntervention5
 Diagnostic processdoes_not_suggest_finding/conditionFinding/condition4
 Diagnostic processhas_dateTime3
 Patientis_referred_byClinician2
 Diagnostic processhas_abandonment_reasonReason1
Tuples used only in the visit transcripts
 Interventionhas_frequencyTime8
 Finding/conditionhas_dateTime5
 Finding/conditionhas_frequencyTime4
 Interventionhas_valueValue3
 Patienthas_contraindicationIntervention2
Tuples used in all data sources
 Patienthas_finding/conditionFinding/condition201528
 Patienthas_intention_of_interventionIntervention142215
 Patienthas_interventionIntervention12259
 Finding/conditionhas_interventionIntervention9610
 Diagnostic processsuggest_finding/conditionFinding/condition1464
Figure 5.

Venn diagram illustrating the number of tuples used within and across all data sources.

Top 5 tuples in each data source and top 5 tuples used in all data sources Venn diagram illustrating the number of tuples used within and across all data sources.

DISCUSSION

We report a collection of concept-relationship-concept tuples to represent patients’ care context data. The formal representation of patients’ care context has already been proposed with the use of relationships found in terminologies such as SNOMED CT. Although SNOMED CT covers relationships of medical knowledge inferences (eg, sinusitis-is_a-disorder of nasal sinus), it does not provide relationships that represent the context surrounding a patient’s care (eg, amoxicillin [for a particular patient]-has_reason-allergic to ciprofloxacin). Such a representation has also been proposed with the use of clinical element models but has not, to our knowledge, been implemented. The concepts and relationships identified can inform the development of formal knowledge representation schemas with normalization to the UMLS Concept Unique Identifiers, thus increasing their generalizability and application for EHR development. Despite the variability of tuples, 459 (73%) sentences were annotated with only 25 (30%) tuples, indicating that with a relatively small combination of concepts and relationships, one can formally represent situations commonly found in clinical encounters, such as interventions ordered (81 instances), findings/conditions present (71 instances), or the intention to start an intervention (69 instances). Although the most used relationships came from the literature, our annotations still produced 31 (65%) new relationships, indicating that specific information reported in clinical notes or spoken communications has not been covered by previous studies. We do not expect that clinicians or domain experts will have to manually create these tuples upfront. Rather, they are intended to be the foundation of a data infrastructure to improve the EHR. We envision a next-generation EHR capable of processing the patient’s care context, represented as a collection of tuples added to what we defined as a patient-specific knowledge base (PSKB). In order to fulfill this vision, some practical, near-term steps for which our starter set of tuples is useful can be performed to build the foundation for more complex, long-term steps to improve EHR functions. The first step involves the creation of a formal ontology representing our classes and relationships, which could be done by applying a widely implemented formalism, such as the Ontology Web Language Description Logic;, however, the most adequate formalism will likely be defined through the evolution of our starter set of tuples in future studies. As part of this process, normalization to UMLS Concept Unique Identifiers can be performed and sub-classes and modifiers that have not been defined but are implicitly represented in our tuples can be created. Also during this process, our current guidelines can be expanded to cover these additional items, allowing expansion of the ontology to cover other potential contextual elements and relationships to increase the dimensionality of our schema, which needs to be tested in future empirical studies. Next, the application of the ontology can be tested with a practical use case, such as the creation of a semantic record navigation, with a PSKB populated with a combination of natural language processing and manual chart review. The hypothesis to be tested is that such a solution would be preferred by clinicians when compared to current navigation patterns that require clinicians to access data through isolated EHR components, or to manually find and read bloated notes that frequently contain redundant information and errors., For example, to verify why a medication was ordered for a patient, a clinician could access a network of concepts linked to the medication (ie, the medication knowledge graph) and navigate to other parts of the record (eg, to notes mentioning the reason for ordering it). Similar knowledge representation has been successfully applied to other informatics solutions and is commonly used in other industries. Although some assertions of the knowledge graph might change over time (eg, patient has pain in 1 visit which has resolved in another), each assertion will have a time stamp in the knowledge base, which can potentially be used to verify when a new assertion negates a previous assertion; however, this hypothesis needs be tested in future studies. Once the ontology has been created, expanded, and validated, another barrier to implementing this vision needs to be overcome: the need to continuously populate a PSKB in real clinical scenarios. This is challenging because clinicians are the only ones who can tell what they are thinking about the patients’ problems, and they are already burdened with EHR-associated documentation. However, the current challenge may become a future opportunity, which leads us to the potential long-term applications of our schema to improve EHR functions. As demonstrated by our transcript annotations, most concepts documented in visit notes tend to be verbally communicated during a visit; although sometimes this commutation uses informal language (eg, “nosebleed” as opposed to “epistaxis”), with the use of a formal ontology these terms could be converted into structured, coded concepts. Based on recent breakthroughs of conversational speech recognition, the accurate transcription of spoken communications will likely be accessible in the near future, allowing the application of a PKSB to improve data entry at the point of care. With proper translation methods,, an ontology of patients’ care context could be parsed by natural language processing systems for concept extraction and other modern language understanding methods for relation classification, forming the data infrastructure for capturing tuples from real-time transcripts of clinical visits. Contextual concepts not represented in standard terminologies (eg, a finding described as “room spinning sensation”) could be classified into an appropriate concept class (eg, value) and added to the PSKB. Coded concepts communicated during a visit could be used to facilitate structured data entry with either a single click (for items explicitly defined: Azithromycin, by mouth, once a day for 5 days) or 2 clicks (for items not defined: Azithromycin); the latter will demand an additional click to select the exact order. Furthermore, this infrastructure could be used to create content for narrative note sections. This could be done by combining standard sentences describing information commonly communicated in clinical notes with information represented in the PSKB or extracted from the patient’s record. For example, the sentence “Patient is a [Age] [gender] who presents for [type of visit] with [reason for visit]” could be converted into “Patient is a 45-year-old female who presents for new patient visit with acute bronchitis.” Likewise, other sentences needed to populate HPI and AP sections could be automatically generated as new information is added to the PSKB. Information relevant for the note but not verbalized during a visit could be extracted from the patient’s record (eg, visit type, referring physician) or prepopulated automatically (eg, standard patient education sentences). As the clinicians realize the benefits of this infrastructure, they can be trained to “think aloud” and verbalize as a many reasoning elements as possible. In addition to facilitating structured and narrative data entry at the point of care, this infrastructure would automatically populate a PSKB and, as more context is added to the knowledge base through new visits and other sources (eg, notes, problem lists, lab results), the PSKB would continuously capture the patient’s care context to empower several EHR functions in a continuous improvement cycle. Examples of long-term improvements that can be obtained from this data infrastructure include learning health systems capable of processing contextual elements in analyses of large-scale data sets and more accurate CDS systems to potentially mitigate the infamous alert fatigue. Imagine CDS systems capable of processing a patient’s care context (eg, patient’s symptoms are getting worse), and when a clinician orders a new chest x-ray (to compare with a previous test from 3 days ago), the system identifies that the frequently overridden alert asking the clinician to consider not ordering the same test within 3 days does not need to be fired (because now its logic can process the reason behind the clinician’s decision: patient’s symptoms worse; no alert needed!).

Limitations

We annotated information from only 3 specialties; the annotation of a greater, diverse group of specialties will likely reveal other tuples. However, we found a large number of tuples used across the different specialties and data sources, and they seem to be useful for representing what one would commonly find in a clinical encounter, thus increasing their generalizability. Patients’ care context data were extracted and represented manually, which may be insufficient to improve EHR functionality; a formal knowledge representation needs to be developed and its validation for the automatic collection of our proposed tuples needs to be tested in simulated and real clinical scenarios. Our proposed solutions for improving the EHR will depend on improvements to and the application of computational methods that are in constant evolution and may still take several years to mature.

CONCLUSION

Based on data reported in previous studies and the annotation of 626 sentences from inpatient and outpatient notes and spoken communications during outpatient visits, we have identified 82 concept-relationship-concept tuples to represent patients’ care context data, with multiple applications for EHR improvements. The tuples include 48 semantic relationships and concepts of 14 distinct classes. We propose several applications of our tuples to improve EHR navigation, data entry, learning health systems, and CDS.

FUNDING

This work was supported by research funds from the Informatics Institute of the University of Alabama at Birmingham.

AUTHOR CONTRIBUTIONS

TKC and JJC conceived this study. TKC collected the data from all sources and parsed the content for annotations. TKC, PID, and JJC conducted the annotations. TKC conducted the data analysis and led the writing of this manuscript, with PID and JJC commenting on subsequent drafts. All authors gave their approval for the final version to be submitted and published.

SUPPLEMENTARY MATERIAL

Supplementary material is available at Journal of the American Medical Informatics Association online. Click here for additional data file.
  27 in total

1.  Standards for detailed clinical models as the basis for medical data exchange and decision support.

Authors:  Joseph F Coyle; Angelo Rossi Mori; Stanley M Huff
Journal:  Int J Med Inform       Date:  2003-03       Impact factor: 4.046

2.  Quantifying clinical narrative redundancy in an electronic health record.

Authors:  Jesse O Wrenn; Daniel M Stein; Suzanne Bakken; Peter D Stetson
Journal:  J Am Med Inform Assoc       Date:  2010 Jan-Feb       Impact factor: 4.497

3.  Report of the AMIA EHR-2020 Task Force on the status and future direction of EHRs.

Authors:  Thomas H Payne; Sarah Corley; Theresa A Cullen; Tejal K Gandhi; Linda Harrington; Gilad J Kuperman; John E Mattison; David P McCallie; Clement J McDonald; Paul C Tang; William M Tierney; Charlotte Weaver; Charlene R Weir; Michael H Zaroukian
Journal:  J Am Med Inform Assoc       Date:  2015-05-28       Impact factor: 4.497

4.  Physician Burnout in the Electronic Health Record Era.

Authors:  N Lance Downing; David W Bates; Christopher A Longhurst
Journal:  Ann Intern Med       Date:  2019-02-05       Impact factor: 25.391

5.  Clinicians' reasoning as reflected in electronic clinical note-entry and reading/retrieval: a systematic review and qualitative synthesis.

Authors:  Tiago K Colicchio; James J Cimino
Journal:  J Am Med Inform Assoc       Date:  2019-02-01       Impact factor: 4.497

6.  Alert override as a habitual behavior - a new perspective on a persistent problem.

Authors:  Melissa T Baysari; Amina Tariq; Richard O Day; Johanna I Westbrook
Journal:  J Am Med Inform Assoc       Date:  2017-03-01       Impact factor: 4.497

7.  Unintended Consequences of Machine Learning in Medicine.

Authors:  Federico Cabitza; Raffaele Rasoini; Gian Franco Gensini
Journal:  JAMA       Date:  2017-08-08       Impact factor: 56.272

8.  Electronic Health Record Usability Issues and Potential Contribution to Patient Harm.

Authors:  Jessica L Howe; Katharine T Adams; A Zachary Hettinger; Raj M Ratwani
Journal:  JAMA       Date:  2018-03-27       Impact factor: 56.272

9.  Knowledge Author: facilitating user-driven, domain content development to support clinical information extraction.

Authors:  William Scuba; Melissa Tharp; Danielle Mowery; Eugene Tseytlin; Yang Liu; Frank A Drews; Wendy W Chapman
Journal:  J Biomed Semantics       Date:  2016-06-23

10.  NOBLE - Flexible concept recognition for large-scale biomedical natural language processing.

Authors:  Eugene Tseytlin; Kevin Mitchell; Elizabeth Legowski; Julia Corrigan; Girish Chavan; Rebecca S Jacobson
Journal:  BMC Bioinformatics       Date:  2016-01-14       Impact factor: 3.169

View more
  2 in total

1.  The anatomy of clinical documentation: an assessment and classification of narrative note sections format and content.

Authors:  Tiago K Colicchio; Pavithra I Dissanayake; James J Cimino
Journal:  AMIA Annu Symp Proc       Date:  2021-01-25

2.  Capturing Clinician Reasoning in Electronic Health Records: An Exploratory Study of Under-Treated Essential Hypertension.

Authors:  James J Cimino; Heather D Martin; Tiago K Colicchio
Journal:  AMIA Annu Symp Proc       Date:  2021-01-25
  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.