Trends in COVID-19 School Related Inquiries Using 311 New York City Open Data.

This study aimed to assess the coronavirus disease (COVID-19) school-related information New York City residents sought through the 311 Call Center. July to November inquiries were downloaded from the NYC Open Data website for 2018-2020. Calls were categorized as related to "Schools", "Access", "Food", "Hospitals", "Transportation", and "Unemployment". Overall call types, and among school-related calls, detailed call types, were compared over the years, using chi-squared tests. School-related inquiries increased by 71% from 2018 to 2020. During 2020, the most common (49%, n = 22,471) call description was "Coronavirus and Schools", encompassing calls about learning options, safety, and resources. Spikes in these calls corresponded to official announcements, including those about Fall reopening plans (August 31: n = 678; September 1: n = 624) and schedules and staffing (September 16th: n = 1043; September 17th: n = 713), and after the start of in-person learning (September 21: n = 680). This study demonstrates that as government officials updated NYC schooling plans for Fall 2020, there were increased concerns among NYC residents. Future COVID-19 schooling changes need to be conveyed clearly and disseminated effectively in order to avoid confusion about NYC's pandemic learning strategy and to address health and safety concerns.

Introduction

The novel coronavirus disease (COVID-19), caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), was first observed in Wuhan, China in December, 2019 and was declared a pandemic by the World Health Organization on March 11, 2020 [1]. The primary mechanism of transmission of COVID-19 is contact with respiratory droplets [2] or aerosols from an infected person [3]. In an effort to mitigate the rapid transmission of the virus, the New York State (NYS) governor declared a state of emergency on March 12, 2020 [4], and subsequently banned all large gatherings on March 20, resulting in statewide school and business closures [5]. State officials across the United States (US) enacted similar orders, resulting in nationwide elementary and high school closures throughout March [6].

Public schools in New York City (NYC) remained closed for in-person learning through the end of the Spring 2020 semester, deferring to remote learning through online platforms. Similar decisions were made in Chicago and Los Angeles [7], the next two largest public school systems in the country. Although these cities all experienced high positive test rates during the first peak of the pandemic in March 2020 (NYC = 40%; LA = 40%; Chicago = 21%) [8], they each followed different reopening paths, based on COVID-19 metrics. Government officials in both LA (Positivity Rate 10% in July 2020) [8] and Chicago (Positivity Rate 6% in July 2020) [8] made the proactive decision in July to keep schools closed for in-person learning for the entire Fall 2020 semester [9, 10]. In NYS (Positivity Rate of 1.5% in July 2020) [8], officials determined students could return to in- person learning, provided that school districts continued to meet the COVID-19 metrics specified by the state health department. Under these guidelines, if COVID-19 case counts or positivity rates within a given community exceeded accepted thresholds, those school districts would be required to change to remote learning [11]. This decision wasn’t made until August, leading to widespread uncertainty, and ultimately translated to a series of openings and partial closings throughout the semester. Challenges included virus transmission, access to remote learning options and technology, childcare options, and access to school meals for food-insecure students. Therefore, NYC presents a unique opportunity to assess the information seeking behaviors of residents in regards to COVID-19 related school re-openings and closures.

The goal of this study was to understand the information seeking behaviors of NYC residents during the phased re-opening of NYC by assessing the frequency of school related, and specifically COVID-19 and school related, calls to NYC’s 311 informational service line, from July to November of 2020. 311 has long served as a key resource for NYC residents to access information regarding school calendars and closures, school enrollment, and other necessary NYC school related information [12]. Understanding these patterns may help inform more timely government decisions and improve information dissemination strategies to reduce confusion. As schools diverged in learning plans for the fall semester, we hypothesize that NYC residents utilized the 311 Call Center for school related questions, specifically regarding COVID-19, more than in previous years.

Methods

The 311 Call Center is a non-emergency service line where residents can submit service requests, file official complaints, and obtain general information on NYC resources and agencies [12]. Language assistance for non-English speakers is available in 6 languages; Spanish, Russian, Cantonese, Mandarin, Korean or Creole. NYC Open Data is a publicly available database that includes all the calls received by the 311 Call Center [12]. This database is updated daily and contains calls from 2010 to the present, along with the date the call was placed, the agency to which the call was directed, the general category of the inquiry, a brief description, and the resolution of each call. Data from the NYC 311 Call Center was directly downloaded from the NYC Open Data website to analyze the frequency and trends of school related calls in NYC.

Calls from July 7—November 22 in 2018, 2019 and 2020 were queried for this analysis. The timeline for analysis was identified based on when NYC entered Phase 3 of its re-opening (July 6, 2020), and when the Mayor announced schools would remain closed for the remainder of the Fall semester (November 18, 2020). When NYC entered Phase 3, school-plans for the fall semester had not yet been announced. [13] Data from the most recent two years were selected to provide a baseline comparison. In order to compare the change in school related calls to other COVID-19 relevant inquiry types, calls were categorized as being related to “Schools”, “Access”, “Food”, “Hospitals”, “Transportation”, and “Unemployment”, based on the presence of those key words in the inquiry name. The key word “School” was specifically excluded when querying the other categories so calls that had already been identified as school-related were not captured twice. A chi-squared test was performed to compare the frequency of each categorized inquiry type across years, relative to the total number of calls received by 311 in the time frame, in order to assess trends over time.

Among the subset of calls that were classified as school related, the frequency of call types, including general school related calls and COVID-19 related school calls were examined by inquiry type and compared over the years. Calls classified as “Coronavirus (COVID-19) and Schools” included those seeking information about learning options, school health and safety, and resources for students during the COVID-19 pandemic. Chi-squared tests were performed to compare the frequency of specific school related inquiries over time, relative to the total number of school related calls, to assess trends from 2018 to 2020, and identify specific areas of greatest concern to residents.

To visualize the impact of major public news announcements on COVID-19 school related calls during the pandemic, call inquiries tagged as “Coronavirus (COVID-19) and Schools” were quantified per day and superimposed with a timeline of COVID-19 related events and official public announcements, collected from publications, major news sources, and the NYS government outlets [11, 14].

Results

311 Call Types by Year

There were 2,421,287 calls in 2018 (32,836 school related; 1.4%); 2,017,850 calls in 2019 (30,626 school related; 1.5%); and 1,930,251 calls in 2020 (45,602 school related; 2.4%). There was a statistically significant (p < 0.01) difference over time in the relative frequency of all listed COVID-19 related call types, potentially due to the large sample size of calls. From 2018 to 2020 the percent of “School” calls increased by 71%. The percent of “Access” calls, including those related to disability access, Access NYC, and Access-A-Ride, increased by 150%. There was a 500% increase in the percent of calls seeking information on “Unemployment” and a 200% increase for “Transportation”, which included medical transport and public transportation (MTA) calls. A 5% decrease in all other types of calls was observed from 2018 to 2020 (Table 1).

Table 1

Frequency of NYC 311 Call Center Inquiry types from July 7-November 22 during 2018, 2019 and 2020

	2018 n(%)	2019 n(%)	2020 n(%)	% change 2018–2020
Access	4798 (0.2)	6861 (0.3)	8928 (0.5)	150%
Food	28,595 (1.2)	30,333 (1.5)	62,875 (3.3)	175%
Hospital	8627 (0.4)	8381 (0.4)	7111 (0.4)	3%
School	32,836 (1.4)	30,626 (1.5)	45,602 (2.4)	71%
Transportation	6795 (0.3)	29,975 (1.5)	16,930 (0.9)	200%
Unemployment	1590 (0.1)	1923 (0.1)	11,236 (0.6)	500%
Other	2,338,046 (96.6)	1,909,751 (94.6)	1,777,569 (92.1)	− 5%
Total	2,421,287	2,017,850	1,930,251	− 20%

n number of calls

School-Related 311 Calls

Changes in the distribution of specific school-related inquiries over time were all statistically significant (all p < 0.05). From 2018 to 2020 additional specific school related inquiries tags were added to the 311 Call Center database. For example, “Other Ways to Graduate High School” was added as a call inquiry during 2019 and “School Re-opening Complaint” and “Coronavirus (COVID-19) and Schools” were added during 2020 as a result of the COVID-19 pandemic. The total number of school-related inquiries increased by 39% from 2018 to 2020. During 2020, the most common (49%, n = 22,471) call description was “Coronavirus (COVID-19) and Schools”. In prior years, the most common call inquiry during this time period was “School Calendar and Closures” (2018, n = 8855 (27.0%); 2019, n = 6824 (22.3%)). Other common inquiries were “School Finder” (2018, n = 2530 (7.7%); 2019, n = 1463 (4.8%); 2020 n = 1117 (2.5%)) and “Property Tax Assistance—School Tax Relief (STAR)” (2018, n = 2501 (7.6%); 2019, n = 5854 (19.1%); 2020 n = 3183 (7.0%)). From 2018 to 2020 there was an increase in the frequency of “School internet access” inquiries (2018 n = 2; 2020 n = 61) (Table 2).

Table 2

Percentage of NYC 311 Call Center Inquiry calls related to Schools from July 7-November 22 during 2018, 2019 and 2020

Inquiry	2018 n(%)	2019 n(%)	2020 n(%)	p-value
Alternative schools and programs	81 (0.3)	33 (0.1)	184 (0.4)	< 0.0001
Coronavirus (COVID-19) and schools			22,471 (49.3)
Home instruction and schooling	167 (0.5)	204 (0.7)	209 (0.5)	0.0004
Other Ways to Graduate High School		64 (0.2)	40 (0.1)	< 0.0001
Property tax assistance—school tax relief (STAR)	2,501(7. 6)	5,854 (19.1)	3,183 (7.0)	< 0.0001
School calendar and closures	8,855 (27.0)	6,824 (22.3)	1,924 (4.2)	< 0.0001
School finder	2,530 (7.7)	1,463 (4.8)	1,117 (2.5)	< 0.0001
School food	20 (0.1)	59 (0.2)	85 (0.2)	< 0.0001
School health complaint	293 (0.9)	35 (0.1)	4 (0.01)	< 0.0001
School internet access	2 (0.01)	5 (0.02)	61 (0.1)	< 0.0001
School reopening complaint			909 (2.0)
School safety complaint	412 (1.3)	147 (0.5)	17 (0.04)	< 0.0001
School teaching and learning complaint	414 (1.3)	37 (0.1)	53 (0.1)	< 0.0001
School transfer	861 (2.6)	884 (2.9)	1,320 (2.9)	0.0475
Other inquiries	16,700 (50.9)	15,017 (49.0)	14,025 (31.0)	< 0.0001
Total # of school related calls	32,836	30,626	45,602

n number of calls

Spikes in the volume of “Coronavirus (COVID-19) and Schools” inquiries corresponded to when announcements about reopening changes were made by state and city public officials (Fig. 1). On August 7, the NYS Governor announced schools would reopen for in-person learning for the Fall 2020 semester; by August 12 the “COVID-19 and Schools” inquiry tag was made available in the 311 Call Center. A spike in these 311 calls occurred between August 31 (n = 678) and September 1 (n = 624). A second spike occurred between September 16 (n = 1,043) and 17th (n = 713) when the NYC mayor announced the school reopening schedule and staffing plan, followed by a spike on September 21 (n = 680) when pre-K and special needs classes began in-person learning. During October, there were no major announcements pertaining to schools; subsequently the volume of calls per day began to decrease. A smaller spike in calls occurred on November 19 (n = 269) when NYC public schools closed for a 2-week period as a result of the increase in COVID-19 cases.

Fig. 1

Number of “Coronavirus (COVID-19) and Schools” inquiries per day from August 12- November 22, 2020 along with a timeline of major COVID-19 and School related news announcements

Discussion

We show here that the distribution of 311 call types has changed significantly from before the pandemic. The COVID-19 pandemic substantially changed external circumstances, and the relevant concerns and information seeking behaviors of NYC residents have changed as a result. The influx of calls related to unemployment, schools, and food insecurity is not surprising, as the pandemic and corresponding state and local guidelines have left NYC residents with a pronounced level of uncertainty in their lives, particularly around childhood learning and school systems. This study highlights that NYC residents are actively seeking information on learning, school health and safety, and school related resources and tools. From 2018 to 2020 there was an increase in calls seeking information on alternative schools and programs, school internet access, and school food. The increase in these school inquiry types was likely exacerbated by the pandemic, as the guardians of school aged children struggled to adapt to remote learning. Additional challenges may have stemmed from the quick changes to policy and school plans that occurred as COVID-19 metrics fluctuated.

School related calls peaked around major public news announcements related to school closures/openings and policy changes. This suggests that NYC residents actively sought additional or clarifying information on these announcements. NYC schools remained closed from March to June 2020 and uncertainty regarding school format and scheduling for Fall 2020 persisted throughout summer [15]. On August 7 the Governor announced that public schools would be permitted to open in the fall if infection rates were below pre-defined thresholds [16, 17]. However, even after this news announcement it was unclear which NYC school districts would meet the necessary COVID-19 health and safety requirements for in-person learning or partial re-opening.

NYC is unique in that it is the only one of the three largest school districts (NYC, LA and Chicago) to have opted for a more fluid and dynamic decision process, where schools were allowed to open for in-person learning as long as the COVID-19 metrics were below a certain threshold. In order to avoid confusion, government officials and policy makers should make decisions pertaining to school systems and learning options for elementary and high school students in a timely manner. Such decisions must also be communicated clearly in order allow NYC residents time to prepare for any future changes in school schedules. Other major school districts, including Los Angeles and Chicago, decided early to keep schools closed for in-person learning during the Fall 2020 [9, 10], with the hopes of being able to return to in-person learning for Spring 2021. In these cities, school systems and parents had a more stable plan and more time to prepare for remote learning, including acquisition of tablets or computers with access to reliable internet. Additionally, working parents were given more time and warning to make arrangements for childcare. Adequate time to plan for and adjust to these changes is necessary. This would allow parents and school districts to better obtain resources for distance learning and make adjustments to work schedules or caretaker options.

Another lesson learned from this unexpected situation is the importance of conducting periodic needs assessments among NYC residents to measure the impact of school closures. This could help determine the school districts that require additional resources for learning (e.g. tablets), as well as those that are essential for providing meals to students, thus decreasing parents’ confusion and stress regarding schools and the effects of the pandemic.

NYC is a densely and diversely populated area and the disparities in COVID-19 testing, cases, and mortality in low-income communities within NYC has been well documented [18]. Disparities in these communities extend to alternative learning options and school related resources. Parents or guardians of children living in multi-generational homes, with people at high risk for severe infection [19], may be justifiably reluctant to send their children to school for in person learning [20]. However, many families may lack the technology and resources, including stable internet access and laptops, [21] needed for successful remote learning. School closures may increase food insecurity in children who rely on schools for meals and further economic stress for parents who have to forgo work to provide care at home [22]. Language barriers may also inhibit the ability of parents or guardians to assist children with remote learning. These disparities in COVID-19 school related resources could be one driving force behind the increase in school related calls to the 311 Call Center.

Results presented here should be interpreted within the context of limitations. 311 offers a limited number of language services and therefore, inquiries from NYC residents speaking another primary language may not be captured. It is also possible that NYC residents reached out to specific city agencies directly to request information, bypassing 311. For example, residents with school related questions could have called the DOE directly. The “COVID-19 and School” tag in 311 may also not capture all pandemic and school related inquiries. For example, it is possible that residents sought information on COVID-19 related school closures and the inquiry was captured under “School closures”, instead “COVID-19 and Schools”. Therefore, it possible that this analysis undercounts school inquiries directly related to COVID, although the inclusion of these would strengthen our conclusions that NYC residents are actively seeking information in response to the pandemic, especially regarding schools. The 311 database does not contain information regarding the caller’s area of residence, therefore, this study was unable to identify specific communities where questions and concerns may be more prominent.

Conclusion

NYC residents utilized the 311 Call Center to gain information on learning options, school health and safety, and additional resources for students during COVID-19. As a result of the pandemic, residents were seeking information on schools and unemployment at higher rates than in previous years, likely reflecting delayed decisions, changing plans, and subsequent widespread confusion and concern. Information regarding school systems and resources for remote learning need to be communicated to the general public in an accurate and timely manner to avoid such confusion among residents and allow guardians of school-aged children sufficient time to prepare for changes.