Generic Logic Model for Coronavirus Disease-2019 Responses Based on the South Korean Experience.

BACKGROUND: As the global coronavirus disease-2019 (COVID-19) pandemic continues, many countries have implemented public health policies, such as lockdowns and physical distancing measures, to prevent its spread. South Korea's response to COVID-19, which prevented an increase in confirmed cases and increased resilience, has been considered very effective.
PURPOSE: To analyze Korea's response to COVID-19 in 2020 and develop a logic model to evaluate performance effectiveness in follow-up studies.
METHODS: By content analysis of Korea Disease Control and Prevention Agency (KDCA) press releases, we defined the problems and identified the causes of the health and social effects of the COVID-19 outbreak. Next, we created a problem tree and developed a logic model that comprised inputs, activities, outputs, outcomes, and impacts. Finally, we held expert consultations to obtain expert opinions regarding the logic model and to ensure the model's validity.
RESULTS: South Korea's COVID-19 response policy mitigated the social and health impacts. The 2020 COVID-19 responses had four outcomes (identifying cases on time, preventing transmission of coronavirus infection, effective treatment of COVID-19 cases, protecting public resilience and well-being) and 12 outputs; South Korea conducted 32 activities.
CONCLUSION: The results can be a practical reference for managing problems faced in other countries. Korean policy may be of interest in the future for international decision-makers in charge of policy enforcement and those who may be called on to respond to new infectious diseases.

Introduction

On January 30, 2020, the World Health Organization (WHO) declared coronavirus disease-2019 (COVID-19), a disease of the respiratory tract characterized by a severe acute respiratory syndrome,1 to be a public health emergency of international concern.2 As of December 31, 2020, a total of 82,357,480 cases of COVID-19 was reported, causing 1,802,390 deaths.3 Because of the pandemic, various standards and measures to control the spread of the disease have been adopted worldwide. Many countries have implemented lockdowns and physical distancing measures to prevent the spread of COVID-19, while also working to protect mental health from the effects of the resulting economic crisis.4 This is because the mental health of older adults5 and young people6 is particularly threatened by physical distancing, school closures, and job loss; they are experiencing economic and organizational difficulties7 related to COVID-19. Many countries are attempting to manage mental health problems by providing online counseling and psychological support services;8 online platforms are also actively used in medical services9 for people in need of mental health services and subsidies. In addition, the importance of crisis communication is clear10 in response to growing public fear and distrust in the early stages of COVID-19, particularly concerning fake news and infodemics.11,12 It is important to prevent the spread of COVID-19 and to protect well-being.

SouthKorea’s response to COVID-19, which prevented an increase in confirmed cases and improved resilience, has been considered very effective. The South Korean government implemented diagnostic tests, epidemiological investigations, contact tracing and follow-up, and isolated treatment.13 As a result of such an effective response, the excess death rate due to COVID-19 in Korea has not deviated significantly from the mortality trend in the last 3 years.14 In particular, Korea’s Disaster Emergency Support Subsidy,15 which positively affected low-income households, and psychological counseling reduced the negative social effects of COVID-19. In addition, the KDCA has made efforts to deliver accurate information to the public by identifying incorrect information related to COVID-19.16 Also, South Korea’s economy has contracted only slightly (−1%), and is likely to be the smallest GDP slump among the Organization for Economic Co-operation and Development countries in the pandemic year.17 Compared with the same month in 2019, the overall suicide mortality decreased in 2020, except for increases of 0.6% in February, 1.8% in June, and 0.7% in August.18

Due to the characteristics of severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), the inability to diagnose and treat promptly could negatively impact physical health and well-being. A logic model intuitively represents the elements and processes necessary to respond to COVID-19; it enables advance determination of countermeasures to be taken. The logic model can structure the main strategies to achieve the effect and the policy implementation process19 in a single table. Moreover, it shows which conditions lead to specific outcomes and can assist in evaluating the effectiveness of policies.20,21 A logic model visualizes the inputs, activities, outputs, and outcomes required to achieve an effect. Most research on policy evaluation focuses on the relationship between the independent and dependent variables, leaving various factors affecting policy unaccounted for, thus preventing explanation of the transition from intervention to outcome. The logic model describes the policy process openly by setting out and analyzing the policy components.22 The logic model is a framework developed for monitoring and evaluating performance. Before making a logic model, problem analysis using a problem tree, solution, or objectives analysis should be done. Problem trees can determine the root causes of the main problem, identify the overall picture of problems,23 and suggest solutions.24 We analyzed South Korea’s COVID-19 response in 2020 and developed a logic model to evaluate its performance effect in subsequent studies.

Materials and Methods

Content Analysis for Problem Definition

The data sources in this study were the “Seoul COVID-19 Report,” published by the Seoul Metropolitan Government, and daily press releases by KDCA from January 3rd to December 31st, 2020; data were collected between October 2020 and December 2020. To identify the categories of response activities, a content analysis was conducted in three steps—preparation, organization, and reporting.25 In the preparation phase, we reviewed the source documents and established the unit of analysis as the keywords of sentences that described the response activities. In the organization phase, we identified a total of 409 activities from the source documents and extracted the keywords from those activities. Next, we grouped the keywords into 20 categories. In the reporting phase, we labeled the categories according to the problems encountered, as indicated by the keywords. The relationships among problem categories were assessed and a problem tree was formulated.

From Problem Tree to Logic Model

Creation of the Problem Tree

A problem tree and logic model were developed based on the problem context and categories of activities. A problem tree is a conceptual map that functions via content analysis and problem categorization.25 This is the result of overlapping between the content reporting and problem analysis phases. The problem tree that shows the relationships of the problems is shown in Figure 1.

Figure 1

Problem tree.

Development of the Logic Model

The categories were mapped to the six topics described above. The key policy classification items were listed according to test, tracing, treatment, physical distancing, communication, and resilience categories, identified by reference to the policy classification items of the Seoul COVID-19 Report. After brainstorming sessions with researchers, the categories were grouped into four significant outcomes according to purpose: identifying cases in a timely manner, preventing transmission of coronavirus infection, effective treatment of COVID-19 cases, and protecting public resilience and well-being. One main impact was selected by grouping these outcomes. In , the activities implemented in Korea are in the left column; inputs needed to implement those activities are in the right column. In addition, we present WHO’s indicators to monitor healthcare capacity and utilization for decision-making regarding COVID-19.26 The other outcome indicators refer to the Monitoring and Evaluation Framework Report of the WHO.27

Expert Consultation

We held expert consultations to obtain expert opinions concerning the logic model and to ensure its validity. We formed an expert group that consisted of one infectious disease expert, one health policy analyst, one international development cooperation expert, and five global health experts. The consultation committee had one online meeting and four offline meetings to review the contents and flow of the logic model, as well as the configuration of indicators.

Results

Problem Tree

In South Korea from January to March, problems (lack of equipment related to preventing the spread of infectious diseases and difficulty in management, shortage of human resources and facilities for quarantine, difficulties in implementing and managing physical distancing measures, delayed diagnosis, quarantine difficulty) presented in the problem tree (Figure 1, bottom) occurred. Each of these problems was likely to result in unclear case identification, the uncontrolled transmission of coronavirus infections, ineffective treatment of COVID-19 cases, and a decrease in public resilience and well-being. Ultimately, COVID-19 could have health and social effects. Epidemiological investigation and contact tracing were quickly implemented in South Korea because systems and technologies were established. By a revision of the Act on the Prevention and Management of Infectious Diseases, personal information was available for epidemiological investigation in the event of an epidemic. However, because this problem can potentially be encountered abroad, we presented it in the problem tree. In South Korea, even in the early stages of the COVID-19 pandemic, epidemiological investigations and contact tracing were efficient, enabling isolation and management of suspected patients, thereby suppressing the spread of the disease.28

Results of the Logic Model

We drew the logic model (Table 1) to present the inputs, activities, output, outcome, and impact mechanisms. By classifying 2020 response policies into four outcomes (Identifying cases in a timely manner, preventing transmission of coronavirus infection, effective treatment of COVID-19 cases, protecting public resilience and well-being), we identified factors that contributed to minimizing the harmful physical and social effects of COVID-19. The outputs (two to four per outcome) are listed in Table 1. Activities carried out to achieve the outcomes, as well as the 12 outputs, are listed in Table 1. Only the input types are listed in Table 1; the details of the input required for the activity are provided in . Input consists of resources and a system. Resources include human resources, equipment related to preventing infectious diseases, budget, and infrastructure (). Items classified by the system are preconditions for input and activity, including legal and technical aspects.

Table 1

Logic Model for COVID-19 Responses: Impact, Outcome, Output, and Activities Based on the National Experience of South Korea

Impact: Minimizing Social and Health Impact of COVID-19
Outcome
1. Identifying cases in a timely manner	2. Preventing transmission of coronavirus infection	3. Effective treatment of COVID-19 cases	4. Protecting public resilience and well-being
Output
1-1. Prompt, accurate diagnostic testing	2-1. Reducing the contact rate	3-1. Triage according to severity	4-1. Financial support for affected individuals
1-2. Quick tracing	2-2. Increased quarantine	3-2. Provision of facilities	4-2. Managing and supporting equipment related to preventing infectious diseases
	2-3. Reducing potential environmental exposure	3-3. Provision of medical services	4-3. Provision of mental health services
			4-4. Risk communication for public awareness and participation
Activities
1-1-1) Expanding the number of screening centers nationwide	2-1-1) Implementing tailored physical distancing measures for different settings (facilities, social environment)	3-1-1) Establishing definitions of symptom severity	4-1-1) Financial support by Emergency Coronavirus Relief Funds
1-1-2) Expanding the number of drive-through screening stations nationwide to reduce waiting for time and risk of infection	2-1-2) Infection control at hospital ward (national relief hospital, relief clinic)	3-1-2) Divide medical process according to severity	4-2-1) Managing equipment related to prevention
1-1-3) Active surveillance for highly vulnerable facilities	2-2-1) Increase the number of operational facilities for quarantine	3-2-1) Acquire hospital beds for low-risk patients	4-3-1) Provision of mental health services through hotlines or apps
1-1-4) Onsite diagnostic testing at ports of entry	2-2-2) At airport screening clinics, positive cases are immediately transferred and treated	3-2-2) Acquire quarantine facilities for patients with mild symptoms for COVID-19 treatment and management	4-4-1) Frequent public announcements about COVID-19
1-1-5) Implement prompt evacuation process for people with symptoms (quarantine process)	2-2-3) Rapid expertise development for self-quarantine control and operation, human resources	3-2-3) Acquire hospital beds for mild to less severe cases	4-4-2) Free access to public information in near real-time
1-1-6) Laboratory technical workforce increase	2-3-1) Environmental decontamination in public spaces	3-2-4) Acquire specialized beds for severe cases	4-4-3) Response to disinformation and fake news
1-2-1) Epidemiological investigation and contact tracing	2-3-2) Mandatory (required) mask-wearing	3-3-1) Provision of medical treatment
1-2-2) Collection of visitor information at publicly used facilities via QR codes	2-3-3) Public campaign about personal hygiene and sanitation	3-3-2) Increase the number of dispatched medical personnel
1-2-3) Traveler self-quarantine management (on-site diagnosis) using an app
1-2-4) Increasing number of trained contact tracers
Types of Inputs
Resources- Organization- Human resource(s)/resources- Facilities- Financial resources- Infectious disease management system		System- Infectious disease management system- Laws/regulations/criteria/guidelines- Cooperation- Technology- Infrastructure

Activities Performed to Achieve the First Outcome (Identifying Cases in a Timely Manner)

Prompt, accurate diagnostic testing (1–1 output) and quick tracing (1–2 output) are needed to identify cases in a timely manner (first outcome). The activities in Korea were as follows. First, we expanded the number of screening centers nationwide ((1-1-1) activities) and drive-through screening centers to reduce the waiting time (1-1-2) activities) and risk of infection. In addition, we actively monitored vulnerable facilities ((1-1-3) activities) and conducted on-site diagnostic tests at ports of entry ((1-1-4) activities). We implemented an immediate evacuation process for people with symptoms ((1-1-5) activities) and increased the laboratory technical workforce (1-1-6) activities). We performed an epidemiological investigation and contact tracing ((1-2-1) activities) and collected visitor information ((1-2-2) activities) to improve contact tracing (1–2 output). In addition, we managed traveler self-quarantine using an app (1-2-3) activities) and increased the number of trained contact tracers ((1-2-4) activities).

Activities Performed to Achieve the Second Outcome (Preventing Transmission)

To prevent the transmission of SARS-CoV2 infection (second outcome), we should reduce the contact rate (2–1 output), increase quarantine (2–2 output), and reduce potential environmental exposure (2–3 output). To this end, the activities in Korea were as follows. Physical distancing ((2-1-1) activities) in different settings (facilities, social environment) and sufficient operational facilities for quarantine ((2-2-1) activities) are needed to prevent further virus transmission. In addition, mask-wearing ((2-3-2) activities) should be mandated, and environmental decontamination should be implemented in public spaces ((2-3-3) activities).

Activities Performed to Achieve the Third Outcome (Effective Treatment of COVID-19 Cases)

For effective treatment (third outcome), triage according to severity (3–1 output) must be in place, facilities must be in place (3–2 output), and medical services (3–3 output) must be available. We established definitions of symptom severity ((3-1-1) activities) and divided medical processes based on severity ((3-1-2) activities). In addition, we acquired sufficient patient beds according to severity ((3-2-1), 2), 3) activities). Also, we increased the number of dispatched medical personnel ((3-3-2) activities).

Activities Performed to Achieve the Fourth Outcome (Enhancing Public Resilience and Well-Being)

To protect public resilience and well-being (fourth outcome), financial (4–1 output) support by Emergency Coronavirus Relief Funds and mental services (4–3 output) were provided, accurate information and knowledge related to COVID-19 was reported, and communication with citizens was conducted (4–4 output). In addition, Korea managed equipment related to preventing infectious diseases (4–2 output). We made frequent public announcements about COVID-19 ((4-4-1) activities) and made it accessible in near-real-time ((4-4-2) activities). In addition, accurate information was delivered by the response to fake news ((4-4-3) activities).

Logic Model for South Korea’s COVID-19 Responses: Indicators

We presented objective indicators that can be used to analyze policy effectiveness (Table 2). To evaluate confirmed cases, there is a need to know the time from exposure to confirmation, as well as the positivity rate. As an indicator of coronavirus transmission, the number of new confirmed cases per week must be determined, along with the decrease in movement according to the level of physical distancing. To evaluate the effectiveness of treatment of COVID-19 cases, the total number of COVID-19 admissions and discharges must be recorded, along with determination of mortality and excess mortality. Mechanisms must be in place to collect community feedback for assessment of public resilience and protection of well-being; this information must be provided to the community. Additionally, sufficient economic growth is needed to ensure adequate financial support for affected individuals.

Table 2

Logic Model for COVID-19 Responses: Indicators Based on the National Experience of South Korea

Impact: Minimizing Social and Health Impact of COVID-19	Measurable Indicators
	Population mortality, fatality rateIncidence rateTotal number of COVID-19 discharges; economic growth rate
Outcome	Measurable Indicators
1. Identifying cases in a timely manner	Time from exposure to confirmation; positivity rate
2. Preventing transmission of coronavirus infection	Weekly number of new confirmed casesMovement decreased according to physical distancing level
3. Effective treatment of COVID-19 cases	Total number of COVID-19 admissions and discharges; fatality rateExcess mortality rate
4. Protecting public resilience and well-being	Mechanisms in place to capture community feedback(Hotlines, social listening, surveys, and websites)Ensuring that information has been communicated to the community(YouTube views, fake news response reports)Rate of economic growth
Output	Measurable Indicators
1-1. Prompt, accurate diagnostic testing	Number of testsAsymptomatic case detection rate
1-2. Quick tracing	Time for contact tracing; confirmation rate of contacts by tracing
2-1. Reducing the contact rate	Reduction in the use of public facilities and movement of public transport
2-2. Increased quarantine	Assessment of the number of quarantined personsCurrent status of self-quarantine management
2-3. Reducing potential environmental exposure	Whether a particular facility’s hygiene and quarantine management guidelines are followed
3-1. Triage according to severity	Time and accuracy of bed classification by symptom
3-2. Provision of facilities	Sufficient number of negative-pressure beds available compared to the expected number of confirmed casesProportion of hospital beds occupied by COVID-19 patients
3-3. Provision of medical services	Proportion of cases who are health workersProportion of facilities with personal protective equipment (PPE)Total number of health workers trained in COVID-19 case management
4-1. Financial support for affected individuals	Number of people who received Emergency Coronavirus Relief FundsConsumption of Emergency Coronavirus Relief Funds
4-2. Managing and supporting equipment related to preventinginfectious diseases	Reports concerning misinformation, fake news, hoarding of some medical products, and low quality of equipment related to preventing infectious disease
4-3. Provision of mental health services	Hotline usage
4-4. Risk communication for public awareness and participation	Increased community feedback (hotlines, YouTube channel, surveys, websites, apps)

Discussion

In the logic model, we presented the 3T, physical distancing, and resilience policy in response to COVID-19. In addition, we analyzed the problems caused by the COVID-19 epidemic using a problem tree. Previous studies introduced 3T (testing, tracing, treatment) and physical distancing in the epidemic phase;13 they explained that policies could prevent negative social effects.29 Unlike previous studies13,29 that introduced detailed situations and responses on a small scale, the present report discusses the activities performed on a large scale in response to COVID-19 and the input that should be prepared first.

Preemptive testing for vulnerable high-risk groups (such as religious gatherings, senior care facilities, and correctional facilities)30 and on-site diagnostic testing at ports of entry31 were conducted on a large scale in a short time. The tests increased the positivity rate and prevented the early spread of COVID-19. In addition, we quickly identified cases by introducing new testing methods with reduced contact, such as drive-through and walk-through, and a temporary screening center where anyone who wanted to be tested could be tested. In addition, with the introduction of quick response code-based entry logs in publicly used facilities, the number of contact-traced cases increased significantly.32

Maintenance of personal hygiene, reduced time away from home, and avoidance of large gatherings strengthens physical distancing.33 As the epidemic became severe, the physical distancing level increased, and subway use in Seoul decreased.34 In addition, the transmission of COVID-19 infection was prevented by mandatory face masks in public facilities, along with prevention and control measures.35 Effective treatment was implemented by classifying patients,36 assigning beds, securing available beds according to symptoms, and securing personnel and supplies.37 As a result, the excess mortality rate did not significantly change, compared with 2019.38

Compared with 2019, sales rose after payments to all citizens from the first COVID-19 relief fund, thus contributing to the economic crisis in 2020.39 Most of the COVID-19 relief fund was used within the expiration date and was used for living expenses. In an online poll of COVID-19-related news, the COVID-19 relief fund ranked second and was regarded as a practically helpful economic policy.

Citizen satisfaction is associated with public trust in government in South Korea.40 Citizen opinions concerning public policy build support for government policy-making41 and improve government performance.42 Fake news and disinformation about the effectiveness of prevention and treatment of COVID-19 were actively discouraged and prevented.43 The Seoul Metropolitan Government’s YouTube daily briefing functioned as an essential channel for communicating important changes in the prevention and control situation or policy. Citizens were provided with psychological support and could receive welfare services such as emergency support and treatment cost support.44

An indicator of the effectiveness of South Korean COVID-19 response interventions is presented in Table 1. The logic model developed by the United States Centers for Disease Control and Prevention45 focuses on community mitigation but lacks detailed input. The COVID-19 response logic model developed by the WHO46 focuses on the African region. The Strategic Response Plan pillars function as objectives and support the monitoring and evaluation of planned COVID19 response activities. In the Strategic Response Plan report, there is no evaluation indicator for the economic crisis.46

A logic model can be used as a tool to disseminate findings to academic communities and policymakers, as well as funders. This paper shows that the logic model can help people overcome problems by providing a conceptual framework for checking and identifying inputs and activities that must be performed preemptively. It may be challenging to apply Korea’s COVID-19 response logic model to other countries. However, it would enable the identification of inputs necessary for constructive activities. Already-implemented projects were rearranged within the logic model structure; they showed activities and goals in stages. There was not enough time to develop the logic model before implementing the response policy because an immediate and rapid response was needed upon the emergence of COVID-19. We collected information related to the response implemented in 2020 using Gray Documents and press releases by government agencies. Research and development of preventive and therapeutic interventions in response to COVID-19 has been crucial. However, this study did not incorporate the research and development perspective. Scientific research during the pandemic can arise from urgent needs that may challenge conventional guidelines,47 although such research must be conducted safely and in compliance with the Declaration of Helsinki.48 Sufficient discussion and assessment of the role of research and development in the COVID-19 pandemic response should be reflected in future studies involving logic models.

Implications

The COVID-19 pandemic has a marked impact on the economy, society, culture, legislation, mental health, and finance.49 Cooperation with fields other than health is a prerequisite for successful policy implementation. As demonstrated by the logic model, a pandemic response requires comprehensive collaboration of multiple sectors in public health, sociocultural, economic, and legal areas. Our logic model provides potential indicators for the monitoring and evaluation of pandemic responses. Policy effects can only result from combinations of essential activities in proper balance. Furthermore, securing adequate input—the fundamental component of the logic model—with sufficient resources and enabling systems may be the most crucial and pressing need.

Because the context and situation differ among countries, the components included in the logic model can be modified and improved according to the context. For example, as shown in the problem tree, Korea did not experience considerable difficulty in the initial epidemiological investigation because information technology related to the contact-tracing system was established. In some other countries, despite their minimal resources, insufficient healthcare, and weak surveillance system, social media platforms facilitated effective risk communication and public education.50

Conclusion

This study evaluated Korea’s COVID-19 response policy using a logic model consisting of input, activities, output, outcome, and impact. Korea’s active response to COVID-19 in 2020 mitigated the social and health effects of COVID-19 through timely identification, preventing transmission of coronavirus infection, effective treatment, and protecting resilience and well-being. Because we presented indicators that could evaluate future responses to pandemic-prone acute respiratory infections such as COVID-19, this logic model enables activities through numerous inputs; it shows that various activities produce outputs and outcomes. In addition, collaboration for policy implementation is occurring in various fields, including public health. Other countries are expected to implement this logic model for COVID-19 responses according to their particular situations by building inputs and systems. In addition, if policy evaluation using a logic model is implemented, more rapid measures will presumably be taken when responding to new infectious diseases.