The effect of risk framing on support for restrictive government policy regarding the COVID-19 outbreak.

This confirmatory research investigates the influence of risk framing of COVID-19 on support for restrictive government policy based on two web survey experiments in Russia. Using 2x2 factorial design, we estimated two main effects-factors of risk severity (low vs. high) and object at risk (individual losses vs. losses to others). First, focusing on higher risks had a positive effect on support for the government's restrictive policy. Second, focusing on the losses for others did not produce stronger support for the restrictive policy compared to focusing on personal losses. However, we found a positive moderation effect of such prosocial values as universalism and benevolence. We found that those with prosocial values had a stronger positive effect in the "losses for others" condition and were more willing to support government restrictive policy when others were included. The effects found in our experimental study reveal both positive and negative aspects in risk communication during the pandemic, which may have a great and long-term impact on trust, attitudes, and behavior.

Introduction

As COVID-19 turns into a pandemic, a political debate is simultaneously raging about whether autocracies or democracies are better at fighting epidemics [1]. Media pundits and global health officials praise draconian security measures imposed by the Chinese government to prevent the spread of COVID-19 [2, 3], and severely criticize the Swedish government for being excessively lax and soft about containing the virus [4]. But how many people would rather ’stay at home’ and keep a safe ’social distance’ instead of reaping the benefits of limitless freedom which most of them enjoyed before the COVID-19 outbreak? As of March 2020, approximately 75% of the world population, says Gallup International Association [5]. Indeed, according to a host of public opinion polls, the percentage of those willing to sacrifice some of their human rights to stave off the spread of coronavirus varies from 32% in Japan to 95% in Austria. In Russia, where the first cases had just been registered to that moment, there were 60% [5]. About a year later, in December 2020 the world on average became less willing to sacrifice rights to prevent the spread of the virus—the percentage dropped from 75% to 70%. At the same time, the statistics in Russia dramatically changed, since citizens were hardly willing to sacrifice their rights. Only 39% of Russian citizens were positive about their rights being trampled in order to resolve the public health crisis [6].

One of the possible explanations of willingness to sacrifice some human rights is rooted in the idea of risk perception as a driving force for decision-making. Research argues that risk perception drives support for security policies that infringe on civil liberties. Particularly, willingness to trade off civil liberties for security increases in the aftermath of exogenous shocks including, probably, public health outbreaks. The term, ‘When in danger, turn right’, from Karwowski et al. [7], demonstrates how the COVID-19 threat promotes social conservatism and support for right-wing candidates. Nonetheless, the perception of risk does not develop on its own, so media coverage, for instance, may introduce a disjuncture between perceptions of personal risk and objective estimates of population incidence [8].

Indeed, framing of a message, which is selection and emphasis on some aspects of a message, can have a greater impact on attitudes and behavior than the actual context [9]. Recent studies address the effects of different framings on following the protective measures during the pandemic. For instance, in line with the research on gain-loss framing, scholars found that gain-framed messages are more effective in promoting self-care behaviors [10-12]. At the same time, other scholars either got null results [13], or found that framing effects are observed if conditioned by such individual characteristics as political ideology or socio-demographics [14, 15].

Risk communication is critical to managing public health outbreaks because of deep uncertainty and lack of issue localization [16]. Risk messages presented to citizens openly and timely aim to rectify the knowledge gap in understanding an epidemiological crisis and adjust the public’s behavior to cope with the risk proactively [17]. However, not all messages have the same effect on citizens’ behavior. For instance, while the World Health Organization (WHO) proclaimed the importance of being ‘supportive’ and ‘careful’ towards others [18], the Swedish strategy to manage COVID-19 has been largely based on the personal responsibility of the citizens who receive daily information about, and individually targeted instructions for, self-protection. Which strategy—to protect yourself or to take care of others—works better then?

Political effects of high and low risk framing

The psychometric paradigm in risk perception research suggests that the main risk categorizations are the level of dread people feel about the risk and the familiarity with the risk [19, 20]. The main factor was found to be the dread risk. The higher the score on this factor, the more individuals are willing to support any restrictive measures that can reduce this risk [19]. This paradigm emphasizes the importance of affective responses that individuals have towards potential risk. They coined the term ‘affect heuristic’ to describe these affective responses [20, 21]. Heuristics are biases whereby respondents use only part of the information with which they are provided [22]. Researchers found that the higher the level of dread people feel about the risks, especially if the risks are new and they are frequently discussed in media, the higher the perceived risks are [23].

Higher perceived risks are the main source of enforcing authoritarian attitudes. Social threats increase right-wing authoritarianism [24-26]. The trade-off between civil rights and a high threat to society drives up the willingness to sacrifice rights to reinforce social order [27]. This can be found in risk situations where there is a threat to some particular groups or society overall in the aftermath of pandemics [28], violent crimes, political or economic crises [29], terrorist attacks [30], natural disasters [31], or climate change [32]. Overall, individuals tend to preserve collective security at the expense of freedom, autonomy, and rights, when there are high perceived risks to society.

We rely on the literature that emphasizes the psychological mechanisms behind framing effects and the literature which shows the effect of framing on a number of attitudes [33, 34]. Frames provide some meanings to the events, selecting certain aspects of the perceived reality and making them more salient in communication [35]. They make some opinions available for retrieval and accessible while being exposed to them. Following the distinction, which is made by Chong and Druckman [33], between issue and equivalence framing, we use the former approach to increase the ecological validity of research. We promote high-risk and low-risk as different considerations, since they are usually communicated by politicians. Despite their logical similarity they may not be necessarily perceived as a trade-off without public discussion. As a result, we expect to find that the high-risk framing of COVID-19 would increase support for restrictive government policy compared to low-risk framing.

H1: High-risk framing will have a stronger effect on the support for restrictive government policy compared to low-risk framing.

Who is the main object at risk?

The question of ‘object at risk’ is one of the main categorizations which has an effect on risk perception [36]. COVID-19 is widely recognized to pose a threat to all age groups. However, according to statistics and media, as well as according to restrictive policy regarding particular groups of population, older people are particularly vulnerable, thus they are central to the COVID-19 risk [37]. The politicians and media justified restrictive measures by emphasizing that people themselves can be risk objects, which poses a threat to others, especially for those who are at higher risk. That produced the international ‘Stay home. Save lives’ media campaign. The discourse framed the restrictive COVID-19 measures as a way to save the lives of others. The WHO promoted not only protecting oneself from getting sick but others as well [18] along with being ‘supportive’ and ‘careful’ towards others.

Though economic perspective focuses on self-interest, a number of researchers stress the importance of prosocial behavior. Research shows that higher responsibility for oneself and for others regarding risky decisions, decreases risk willingness and risky behavior [38, 39]. There is evidence that people tend to be more risk averse when they make a choice for others, rather than for themselves [40]. Indicating that vaccination is a prosocial behavior, which results not only in direct protection of the vaccinated but also protection of unvaccinated individuals through herd immunity, increases the willingness to be vaccinated [41, 42]. Individuals tend to be more risk-averse and cautious when their risky behavior can have a negative effect on others [43, 44], or are more willing to take risks in order to help others [45].

In words of Mary Douglas [46], during the COVID-19 pandemic, everyone is described as potentially ‘contaminated’, ‘polluted’, and dangerous to others as everyone can be the asymptomatic carrier of COVID-19 without knowing it, as the symptoms can take up to 14 days to manifest themselves. As a result, everyone can be accused of being a threat to others, and society overall, and punished for not following the rules of self-isolation and staying at home, as breaking the rules can be dangerous to the health of others and society.

Recent research on the effect of prosocial messages on COVID-19 prevention behaviors showed some mixed evidence. While some experimental studies found almost no difference between self-focused and prosocial framing on the willingness to self-isolate and wash hands more often [47, 48], other studies found that prosocial framing indeed increased such prevention behavior as social distancing [49-51] and wearing masks [52]. Some other experimental studies found no effect of prosocial framing on clickthrough rates while delivering advertisements on Facebook, compared to self-focused framing [53] and comprehension of the information regarding recommended behaviors [54]. In spite of this mixed evidence, we suggest that the framing which highlights losses to others would increase support for restrictive government policy compared to the condition in which we highlight only personal losses.

H2: The object at risk which focuses on losses to others will have a stronger effect on the support for restrictive government policy compared to the personal losses framing.

Prosocial values as moderators of framing effects

Following the argument made by Chong and Druckman [33], we suggest that the effect of frames on attitudes is moderated by personal values. We assumed that the frame affects only particular types of individuals with strong prosocial attitudes. It was found in previous literature that such variables as values [55, 56] or personality traits [57] could explain the variation in attitudes towards prosocial behavior like moral decision-making or altruism. According to the norm activation theory, different frames would activate particular personal values depending on the individual’s cognitive structure of these values [55]. As a result, the ‘losses to others’ frame may have an effect only if this is in line with personal values. Some studies showed that higher empathy increases willingness to self-isolate and maintain social distancing during the COVID-19 pandemic [58, 59].

We would apply the Schwartz theory of basic human values and his approach to the measurement of values [60]. Schwartz suggested that there are ten basic human values across cultures. Two of them are in the self-transcendence direction (i.e., prosocial values): benevolence and universalism [61]. Both values suggest that individuals are concerned with the welfare and interests of others, which basically means the transcendence of selfish interests. While benevolence enhances the welfare of in-group members, universalism enhances the welfare of all people beyond the in-group. This theory and approach to the measurement of values showed quite a high validity across many cultures and is used in such cross-cultural studies as the European Social Survey [62]. Some authors argue that such self-transcendent values should have a positive effect on a compliance with COVID-19 restrictive government policy though no empirical evidence has been shown [63]. The mechanism behind it is based on the prioritization of the interests of others at some personal cost. Therefore, we suggest that the ‘losses to others’ framing has a stronger effect on individuals with prosocial values, i.e. with stronger benevolence and universalism values.

H2a: The effect of the object at risk, which focuses on losses to others, will have a stronger effect on the support for restrictive government policy compared to the personal losses framing for the individuals with strong prosocial attitudes.

The context of the study: COVID-19 in Russia

Two experiments were conducted in Russia. Experiment 1 was conducted during the so-called first wave of COVID-19. On March 28, 2020 –the day when Experiment 1 started–the confirmed number of cases in Russia was 1,264. Four people had died from COVID-19 up to that day. On April 24, 2020 when Experiment 1 was finished, a total of 68,622 cases were confirmed, and the COVID-19 death toll reached 615. On March 25, 2020 the President, Vladimir Putin, declared a non-working week in all Russian regions from March 28 to April 5, 2020 [64], which was later extended till April 30 [65], and then till May 11, 2020 [66]. He also entrusted regional authorities full powers to adopt restrictive measures depending on the number of cases in a region [65]. For instance, Moscow, Saint-Petersburg and a number of other Russian regions were placed under lockdown on March 30, 2020 by the decision of local authorities. People were allowed to go outside for medical care purposes, shopping for food and medication, and going to work if remote work was not an option. Besides the obligatory closure of schools, universities, gyms, swimming pools, shopping malls and hair salons, a number of regions including Moscow and Saint-Petersburg launched a digital pass system in April to allow residents to leave their homes for essential reasons as well as a smartphone app to monitor coronavirus patients’ movement in self-isolation [67].

Experiment 2 was conducted during the so-called second wave of COVID-19. As compared with the first wave, the situation with COVID-19 in Russia had largely changed. On November 13, 2020 when Experiment 2 started, the confirmed number of cases in Russia was 1,880,551 and the COVID-19 death toll reached 32,443. During Experiment 2 no lockdown was in place in Russia, as well as there were no non-working weeks. The system of digital passes, which was abolished in all Russian regions by June 9, was no longer used. However, in November 2020 a series of restrictive measures, which were lifted in summer, had been reintroduced across Russian regions to contain the spread of the coronavirus. Nevertheless, such measures as mandatory wearing of face masks and gloves, prohibition of mass events and mass gatherings, reduced capacity of theaters, cinemas, and restaurants, and maintaining social distance had never been lifted from the times of the first wave. The head of Russian Federal Service for Surveillance on Consumer Rights Protection and Human Wellbeing (Rospotrebnadzor), Anna Popova, called for restrictive measures in the regions with the highest numbers of the COVID-19 active cases; and Russian Prime Minister, Mikhail Mishustin, supported this idea [68]. Following this order, for instance, in Moscow, such measures as distance learning and remote work were introduced.

By November 2020 two vaccines against COVID-19 were officially registered in Russia. On 11 August 2020, Russian president Vladimir Putin announced the official approval of the Sputnik-V vaccine. Two month later, on 14 October 2020 another vaccine, EpiVacCorona, was officially registered. However, according to Russian public opinion polls, the vaccine did not make citizens less fearful of the virus. While about 57% of Russians were afraid of getting sick with COVID-19 during the first wave in March 2020, in October 2020 the percentage increased up to 64% [69].

Experiment 1

Participants

Current undergraduate or graduate students of the HSE University were eligible to take part in the experiment, except for students of Political Science and Sociology departments. The consent was obtained in a written form. We invited students via their group emails, which are used for communication between lecturers and students. As a result, according to AAPOR [70] standards, response rates cannot be computed. The number of completed interviews was 762 (N = 762). Completed interviews were determined as those which had more than 80% of the essential questions answered [70].

No course credits were provided for the survey participation and students signed a consent form in which they were told they were free to withdraw from participation at any time they wanted. As an incentive for survey completion, we offered participation in a lottery in which students could win the smart home device, Yandex. Station (the price of around $150 U.S.). The break-off rate was 46% (N = 760), about half of the breakoffs were at the introduction page. Some individuals who reported that they are not students of the HSE University were screened out (N = 118). On average, it took 23 minutes to complete the survey (M = 23.12, SD = 12.69). The baseline characteristics of the final sample are given in S1 File.

Although we used a convenience sample, the use of such samples does not appear to consistently generate false negatives, false positives, or inaccurate effect sizes [71]. Kühberger [34] also finds that the behavior of student participants does not significantly differ from the behavior of non-student participants. However, we cannot estimate conditional average treatment effects (CATEs) using a convenience sample of students for the following reason. We did not expect to observe large variation in values in a convenience sample; there is some evidence that the differences in prosocial values among students are relatively small [72]. Since Mullinix et al. [71] suggest that estimation of CATEs in the experimental studies is problematic when there is lack of variance of the moderator, especially among convenience samples of students, we did not test hypothesis H2a in Experiment 1.

Experimental design

The experimental design was approved by the Council of Peers at Ronald F. Inglehart Laboratory for Comparative Social Research (№ER-2020-01). It is confirmed that the proposed research project conforms to ethical standards in modern social sciences. We designed a web-based experiment with a 2 (risk severity: high vs. low) X 2 (object at risk: individual losses vs. losses to others) factorial design. The subjects were randomly assigned to one of the four conditions: (1) High-risk X Individual losses, (2) High-risk X Losses to others, (3) Low-risk X Individual losses, (4) High-risk X Losses to others. The randomization process was carried out at the individual level and was conducted within the flow of the survey. No restrictions were placed on randomization, and we did not employ blocking. To ensure the effectiveness of randomization we checked for the covariate balance and put these results in S2 File. The p-values of joint orthogonality tests indicate that the group differences are insignificant, except for the probability of COVID-19 infection in the manipulation of the risk severity factor (for the details of statistical analysis, see S2 File). The data collection started on March 28, 2020 and finished on April 24, 2020. As is recommended in Reporting Guidelines for Experimental Research, the CONSORT flow diagram is provided in S3 File.

Materials

The vignettes were structured as the set of rubrics with essentially similar content, yet different framing. The information on the pandemic, scale of the issue, probability of infection / recovery, medical treatment, long-term negative consequences for personal health (yes / no), incubation period, and advice on how to protect yourself / take care of others, were described in texts. The statistics and information in the vignettes were taken from official websites such as the World Health Organization, Russian Federal Service for Surveillance on Consumer Rights Protection and Human Wellbeing, and Russian media sources, in March-April 2020. The length of text varied from 214 to 265 words. Vignettes can be found in Table 1. To ensure that the independent variable had effectively been manipulated and the participants understood risk framing in the way we wanted them to, we used three manipulation checks. Further details of manipulation checks are given in S8 File.

Table 1

Experimental vignettes used in Experiment 1.

	Individual Losses	Losses to Others
Low Risks	Flu pandemic	Flu pandemic
	• World Health Organization (WHO) has announced an outbreak of a novel coronavirus influenza pandemic. An influenza pandemic is announced when a new influenza virus appears and spreads around the world.	• World Health Organization (WHO) has announced an outbreak of a novel coronavirus influenza pandemic. An influenza pandemic is announced when a new influenza virus appears and spreads around the world.
	Spread	Spread
	• World Health Organization recognizes that for most people the risk of infection with a novel coronavirus is very low. Seasonal flu still remains the most common respiratory disease which every year kills up to 650,000 people worldwide.	• World Health Organization recognizes that for most people the risk of infection with a novel coronavirus is very low. Seasonal flu still remains the most common respiratory disease which every year kills up to 650,000 people worldwide.
	Recovery rates	Recovery rates
	• On average, 96 out of 100 people recover from the novel coronavirus.• Countries that have made great efforts to track and trace infected people show that 99 out of 100 people recover—statistics similar to the seasonal flu.	• On average, 96 out of 100 people recover from the novel coronavirus.• Countries that have made great efforts to track and trace infected people show that 99 out of 100 people recover—statistics similar to the seasonal flu.
	Health risks	Health risks
	• In most cases, the symptoms are mild, so no specific medical treatment is required.	• In most cases, the symptoms are mild, so no specific medical treatment is required.
	Incubation period	Effective medications
	• A person can become infected with the novel coronavirus, but it can take up to 14 days for symptoms to appear. Due to this a person can infect other people without knowing that he can be dangerous to others.	• Some antiviral drugs such as Favipiravir have been found to be effective in treating the coronavirus. In Russia, Favipiravir will be available soon.
	Effective medications	Why we can be dangerous to others?
	• Some antiviral drugs such as Favipiravir have been found to be effective in treating the coronavirus. In Russia, Favipiravir will be available soon.	• A person can become infected with the novel coronavirus, but it can take up to 14 days for symptoms to appear. Due to this a person can infect other people without knowing that they can be dangerous to others. So, one infected individual can infect about 5 other people, which allows the disease to spread rapidly and increase the number of infected exponentially.
	How can I protect myself?	We should consider the risks of others
	• Due to the fact that many people are at high risk of death and negative health consequences if they become infected with a novel coronavirus, the World Health Organization recommends a series of measures to protect your own health. The most important and primary measure is regular and thorough handwashing, as well as compliance with the rules of respiratory hygiene.In addition, tough measures against the spread of the virus are aimed at reducing the spread of infection.	In most cases, even no specific medical treatment is required to recover from a novel coronavirus. However, despite the fact that the disease often proceeds in a mild form, the World Health Organization suggests taking care not only of yourself, but also of other people. We can impact not only our health, but also the health of other people. Thus, the spread of the novel coronavirus depends on the actions of each of us. Tough measures against the spread of the virus, if each of us follows them, are aimed at reducing the spread of the infection.
High Risks	Pandemic	Pandemic
	• World Health Organization (WHO) has announced an outbreak of a novel coronavirus infection by pandemic. A pandemic is a global outbreak. People in more than 150 countries were infected with a novel coronavirus.	• World Health Organization (WHO) has announced an outbreak of a novel coronavirus infection by pandemic. A pandemic is a global outbreak. People in more than 150 countries were infected with a novel coronavirus.
	Spread	Spread
	• The WHO experts estimate that up to two-thirds of the world’s population can be infected by the novel coronavirus, which means that up to 5 billion people can be infected. With the current mortality rate that means up to 200 million people can die from the novel coronavirus.	• The WHO experts estimate that up to two-thirds of the world’s population can be infected by the novel coronavirus, which means that up to 5 billion people can be infected. With the current mortality rate that means up to 200 million people can die from the novel coronavirus.
	Mortality rate	Mortality rate
	• On average 4 out of 100 infected people are killed by the novel coronavirus.• There is a risk of severe form of disease and serious health consequences.• One out of five infected people experiences severe symptoms of the disease.• There is a potential decrease in lung function by 20–30% even after recovery. Thus, lung problems may persist after recovery.	• On average 4 out of 100 infected people are killed by the novel coronavirus.• There is a risk of severe form of disease and serious health consequences.• One out of five infected people experiences severe symptoms of the disease.• There is a potential decrease in lung function by 20–30% even after recovery. Thus, lung problems may persist after recovery.
	Incubation period	Effective medications and vaccines
	• A person can become infected with the novel coronavirus, but it can take up to 14 days for symptoms to appear. Due to this a person can infect other people without knowing that he can be dangerous to others.	• There is currently no known medication proven to treat the disease nor the vaccine.
	Effective medications and vaccines	Why we can be dangerous to others?
	• There is currently no known medication proven to treat the disease nor the vaccine.	• A person can become infected with the novel coronavirus, but it can take up to 14 days for symptoms to appear. Due to this a person can infect other people without knowing that they can be dangerous to others. So, one infected individual can infect about 5 other people, which allows the disease to spread rapidly and increase the number of infected exponentially.
	How can I protect myself?	We should take into consideration the risks of others
	• Due to the fact that many people are at high risk of death and negative health consequences if they become infected with a novel coronavirus, the World Health Organization recommends a series of measures to protect your own health. The most important and primary measure is regular and thorough handwashing, as well as compliance with the rules of respiratory hygiene.In addition, tough measures against the spread of the virus are aimed at reducing the spread of infection.	Due to the fact that:• Many people are at particularly high risk of death if they are infected with a novel coronavirus• The infection spreads very quicklyThe World Health Organization suggests taking care not only of yourself, but also of other people. We can impact not only our health, but also the health of other people. Thus, the spread of the novel coronavirus depends on the actions of each of us. Tough measures against the spread of the virus, if each of us follows them, are aimed at reducing the spread of the infection.

Outcome measures and covariates

We had three dependent variables mainly used to ensure the robustness. Descriptive statistics of the dependent variable measures and pre-treatment covariates, which are described in S4 File, are given in Table 2. First, we asked the participants ‘How willing are you to sacrifice some of your rights if this helps prevent the spread of coronavirus in Russia?’, and measured their willingness to sacrifice rights on a 5-point scale (1 –‘not at all willing’; 5 –‘fully willing’).

Table 2

Descriptive statistics of dependent variables and pre-treatment covariates.

Variable	N	M / %	SD	Min	Max
Dependent Variables:
Willingness to sacrifice rights	762	3.34	0.94	1	5
Support for restrictive government policy	762	93.05	13.08	38	110
Support for criminal liability for quarantine violation	762	2.87	1.33	1	5
Control Variables:
Female*	729	77%	--	--	--
Have relatives older than 60*	729	18%	--	--	--
Probability of COVID-19 infection	747	31.44	26.17	0.00	100.00
Scale of COVID-19 in Russia	762	2.99	0.86	1	4
Frequency of check-ups	729	3.12	0.96	1	5
Government capacity to deal with the pandemic	758	3.77	0.95	1	5
Watching pro-government news	747	2.05	1.56	1	6

Note: Dummy variables are marked with an asterisk.

Second, we provided the participants with a list of 22 restrictive government policies which either had already been adopted by the Russian government or were being discussed in order to prevent the further spread of COVID-19. The complete list of security measures is given in S5 File. So, we asked the participants ‘To what extent do you support the following measures to prevent the spread of coronavirus in Russia’ and measured their level of support on a 5-point scale from 1 –‘do not support at all’ to 5 –‘fully support’. We then added up the points from respondents’ answers and used the resulting sum as the measure of participants’ support for restrictive government policy (Cronbach’s alpha, α = 0.91; [0.90; 0.92]).

Third, we asked the participants ‘To what extent do you support the introduction of criminal liability for violation of the quarantine in Russia?’ and measured their support for criminal liability on a 5-point scale (1 –‘do not support at all’; 5 –‘fully support’). This question appeared separately from other questions on restrictive government policies, since the intention of the Russian government to adopt it was harshly criticized in various media sources. Many people found this measure too severe and violating human rights, which resulted in public outrage on social media.

Results

Group means comparisons are summarized in Table 3 and Fig 1. As expected, we found statistically significant differences in the support for restrictive government policy (F(3, 762) = 4.68, p < 0.01) and support for criminal liability for the quarantine violation (F(3, 762) = 2.72, p < 0.05) between four treatment conditions. Though we did not find evidence of significant differences in means of the willingness to sacrifice rights (F(3, 762) = 1.82, p = 0.142) between experimental conditions, the effect of risk framing was proven to be statistically significant in 2 of 3 measures for the dependent variable. Pairwise comparisons of experimental conditions and be found in S6 File.

Table 3

Group means of experimental conditions in a completely randomized 2x2 factorial design.

Variable	Individual losses		Losses to others		F
	Low-risk	High-risk	Low-risk	High-risk
Willingness to sacrifice rights	3.28 (0.96)	3.44 (0.93)	3.23 (0.95)	3.39 (0.92)	1.82
Support for restrictive policy	91.57 (13.88)	94.51 (12.65)	90.9 (14.14)	94.91 (11.31)	4.68**
Support for criminal liability	2.74 (1.37)	2.96 (1.34)	2.72 (1.31)	3.03 (1.28)	2.72*
N	180	193	184	205

Note: Group means and standard deviations (in brackets) are given in the table. F-statistics are given in the last column. Significance levels are at

*p<0.05

**p<0.01

***p<0.001.

All tests are two-tailed.

Fig 1

From left to right, the group means with 95% error bars in a) the willingness to sacrifice rights, b) the support for restrictive government policy, and c) the support for criminal liability for quarantine violation.

To estimate average treatment effects of the main factors, we ran t-tests. We found strong support of H1 for all three measures of the dependent variable. The differences between means of participants’ willingness to sacrifice rights in high-risk (M = 3.41, SD = 0.92) and low-risk (M = 3.26, SD = 0.96) conditions are statistically significant (t(760) = 2.222, p < 0.05), so the ATE of risk severity on the willingness to sacrifice rights is 0.15 ([0.02; 0.29]) on a 5-point scale, Cohen’s d = 0.16. The same is true for the measure of support for restrictive government policy. The high-risk group mean (M = 94.72, SD = 11.97) and the low-risk group mean (M = 91.23, SD = 14) are significantly different (t(760) = 3.707, p < 0.001), meaning that the ATE of risk severity on the support for restrictive government policy is 3.49 ([1.64; 5.34]), Cohen’s d = 0.27. Regarding the support for criminal liability for the quarantine violation, we also found a statistically significant difference (t(760) = 2.805, p < 0.01) between the high-risk (M = 3.00, SD = 1.31) and low-risk groups (M = 2.73, SD = 1.34), so the ATE is 0.27 ([0.08; 0.46]) on a 5-point scale, Cohen’s d = 0.20.

OLS regression models (see Table 4; see also S7 File) confirm the results of t-tests. Overall, these results prove that the high-risk framing has a stronger effect compared to the low-risk framing on willingness to sacrifice rights (β = 0.152, p < 0.05), the support for restrictive measures (β = 3.489, p < 0.01), and the support for criminal liability for the quarantine violation (β = 0.269, p < 0.01).

Table 4

OLS regression models estimates of main effects and interactions; pre-treatment covariates as controls are not included.

	Dependent variable:
	Willingness to sacrifice rights		Support for restrictive government policy		Support for criminal liability
	(1)	(2)	(3)	(4)	(5)	(6)
Intercept	3.283***	3.283***	91.283***	91.567***	2.719***	2.744***
	(0.060)	(0.070)	(0.830)	(0.968)	(0.085)	(0.099)
Factor of Risk Severity: High-Risk	0.152*	0.152	3.489***	2.941*	0.269**	0.219
	(0.068)	(0.097)	(0.942)	(1.346)	(0.096)	(0.137)
Factor of Risk Target: Losses to Others	-0.050	-0.050	-0.109	-0.670	0.024	-0.027
	(0.068)	(0.099)	(0.941)	(1.362)	(0.096)	(0.139)
High-Risk X Losses to Others		-0.0002		1.074		0.097
		(0.136)		(1.885)		(0.192)
N	762	762	762	762	762	762
Adjusted R2	0.005	0.003	0.015	0.014	0.008	0.007
F Statistic	2.734†	1.821	6.867**	4.682**	3.959*	2.722*

Note: Unstandardized beta coefficients are given in the table. Standard errors are in parentheses. Significance levels are at

†p<0.1

*p<0.05

**p<0.01

***p<0.001.

All tests are two-tailed.

In contrast, we did not find any evidence of H2. We found that the difference in willingness to sacrifice rights between the ‘individual losses’ (M = 3.36, SD = 0.95) and the ‘losses to others’ (M = 3.31, SD = 0.94) groups is not statistically significant (t(760) = 0.708, p = 0.479). There is also no evidence that the support for restrictive government policy is any different (t(760) = 0.080, p = 0.937) for those who were exposed to personal losses framing (M = 93.09, SD = 13.32) in comparison with those who were shown the object at risk, which indicates losses to others (M = 93.01, SD = 12.87). The support for criminal liability for the quarantine violation was not proved to be appreciably different (t(760) = 0.274, p = 0.784) between the ‘individual losses’ (M = 2.86, SD = 1.36) and the ‘losses to others’ (M = 2.88, SD = 1.30) conditions. Therefore, there are no grounds for accepting the second hypothesis. We conclude that the object at risk which indicates losses to others does not have a stronger effect on the support for restrictive government policy compared to the personal losses framing. OLS regression models (see Table 4; see also S7 File) confirm the results of t-tests; there are no statistically significant effects of ‘losses to others’ frame compared to ‘individual losses’ on willingness to sacrifice rights (β = -0.05 p = 0.465), the support for restrictive measures (β = -0.109, p = 0.908), and the support for criminal liability for the quarantine violation (β = 0.024, p = 0.804).

We also estimated interaction effects between main experimental factors. Models 2, 4, and 6 in Table 4 demonstrate that there are no statistically significant interaction effects between risk severity factor and object at risk, neither on willingness to sacrifice rights (β = -0.000, p = 0.999), nor on the support for restrictive government policy (β = 1.074, p = 0.569), nor on the support for criminal liability for the quarantine violation (β = 0.097, p = 0.612).

Interestingly enough, we found that the participants who were exposed to the ‘low-risk’ framing (M = 2.91, SD = 0.59) were less convinced of the credibility of the information (t(760) = -4.938, p < 0.001) than those who were in the ‘high-risk group’ (M = 3.1, SD = 0.49) (see S8 File for more details). We found that the CATEs (conditional average treatment effects) of risk severity framing increase for those who perceived the information as credible (see S8 File).

Experiment 2

To calculate the CATEs and effect sizes among the general population, we conducted the second study during the so-called ‘second wave of COVID-19’ using a volunteer online access panel, managed by Online Market Intelligence (OMI) in Russia. The panel has ISO 20252 certification. The consent was obtained in a written form. The number of completed interviews was 1,570. The participation rate [70] was 5%. The break-off rate was 9.6% (N = 187). Some respondents were screened out (N = 7) or started completing the survey when some quotas were full (N = 181). There were some nationally representative quotas on gender, age, federal district, and level of education.

On average, it took 29 minutes to complete the survey (M = 28.6; SD = 20.41). We have excluded from the analysis those respondents who showed low data quality, which is extremely quick reading of the vignettes and straight lining in grid questions [73]. Overall, we included 1,438 respondents (N = 1,438). About 55% were females. The mean age was 46 (M = 45.65, SD = 14.08). Other baseline characteristics of the final sample are given in S1 File.

The experimental design was approved by the Council of Peers at Ronald F. Inglehart Laboratory for Comparative Social Research (№ER-2020-02). It is confirmed that the proposed research project conforms to ethical standards in modern social sciences. The design was similar to Study 1, with a 2 (risk severity: high vs. low) X 2 (object at risk: individual losses vs. losses to others) factorial design. The data collection started on November 13, 2020 and finished on November 19, 2020. To ensure the effectiveness of randomization we checked for the covariate balance and put these results in S2 File. The p-values of joint orthogonality tests indicate that the group differences are insignificant, except for higher education, in the manipulation of the object at risk factor (for the details of statistical analysis, see S2 File). The CONSORT flow diagram is provided in S3 File.

Since this was the second wave of COVID-19 pandemic we changed the wording of vignettes. We excluded some basic information which was quite new at the beginning of the COVID-19 pandemic (e.g., about the pandemic overall, spread of the issue, incubation period), but was common knowledge at the beginning of the second wave—10 months after the pandemic was declared. As a result, the number of words has been substantially decreased compared to Experiment 1. The length of text varied from 79 to 117 words. Moreover, to the moment of the second Experiment, the statistics and media coverage had changed since the beginning of the COVID-19 pandemic. Previous research has shown that the proportion of news frames has changed during different time periods depending on if it was pre-crisis, lockdown or recovery period of COVID-19 pandemic [74-76]. Following the idea of agenda-setting effects [77] we have updated some relevant and excluded some outdated information in order to make vignettes more habitual for respondents. We described the scale of the issue / recovery, medical treatment, and the advice on how to protect yourself / take care of others. The statistics and information in the vignettes were taken from Russian Federal Service for Surveillance on Consumer Rights Protection and Human Wellbeing, and Russian media sources in November 2020. Vignettes can be found in Table 5. We used the same manipulation checks. Further details of manipulation checks are given in S8 File.

Table 5

Experimental vignettes used in Experiment 2.

	Individual Losses	Losses to Others
Low Risks	Although there is an outbreak of a new coronavirus, the World Health Organization recognizes that for most people, the risk of being infected is very small.	Although there is an outbreak of a new coronavirus, the World Health Organization recognizes that for most people, the risk of being infected is very small.
	In Russia, 98 out of 100 people recover—statistics similar to the seasonal flu.	In Russia, 98 out of 100 people recover—statistics similar to the seasonal flu.
	There are medications and a vaccine for the new coronavirus.	There are medications and a vaccine for the new coronavirus.
	In most cases, no specific medical treatment is required to recover from the coronavirus.	In most cases, no specific medical treatment is required to recover from the coronavirus.
	Despite the fact that the illness is most often mild, some measures are taken at the state level to prevent outbreaks of recurrent infection. At the same time, a great responsibility lies with each of us. The World Health Organization advises to take a number of measures to protect your own health.	Despite the fact that the illness is most often mild, some measures are taken at the state level to prevent outbreaks of recurrent infection. At the same time, a great responsibility lies with each of us. The responsibility not only to take care of oneself, but also of the health of other people. We are responsible for saving other lives. During a pandemic, the World Health Organization advises to take a number of measures not only to protect your health, but also the health of others.
High Risks	The number of infected with COVID-19 has reached almost 40 million people. More than 1 million people have died from the new coronavirus. The global coronavirus situation remains very tense.	The number of infected with COVID-19 has reached almost 40 million people. More than 1 million people have died from the new coronavirus. The global coronavirus situation remains very tense.
	Recently, there has been a rapid increase in the number of infected. As a result, many countries impose new restrictions and declare a second wave of new coronavirus.	Recently, there has been a rapid increase in the number of infected. As a result, many countries impose new restrictions and declare a second wave of new coronavirus.
	At the state level, some measures were taken to prevent outbreaks of recurrent infection, however a great responsibility lies with each of us. During a pandemic, the World Health Organization advises to take a number of measures to protect your own health.	At the state level, some measures were taken to prevent outbreaks of recurrent infection, however a great responsibility lies with each of us. The responsibility not only to take care of oneself, but also of the health of other people. We are responsible for saving other lives. During a pandemic, the World Health Organization advises to take a number of measures not only to protect your health, but also the health of others.

We had the same three dependent variables used in Experiment 1. Descriptive statistics of the dependent variable measures and pre-treatment covariates, which are described in S4 File, used in the second experiment are given in Table 6. However, we have slightly changed the list of restrictive government policies to prevent the further spread of COVID-19, since most of the measures used in the first study were no longer relevant to the context. Similar to the first experiment, we added up the points from respondents’ answers and used the resulting sum as the measure of participants’ support for restrictive government policy (Cronbach’s alpha, α = 0.91; [0.90; 0.92]). The list of 10 policies included in Experiment 2 is given in S5 File. We used the 21-item short version of Scwartz’s portrait values questionnaire [60] to measure prosocial values and test H2a. The focus of our experimental study was the self-transcendence direction, in particular, benevolence and universalism. The value scores were centered to measure the priority given to each of the value types as suggested by Schwartz [78].

Table 6

Descriptive statistics of dependent variables and pre-treatment covariates.

Variable	N	M / %	SD	Min	Max
Dependent Variables:
Willingness to sacrifice rights	1438	2.96	1.14	1	5
Support for restrictive government policy	1438	34.61	9.49	10	50
Support for criminal liability for quarantine violation	1438	2.32	1.29	1	5
Moderating Variables:
Schwartz’s values: Benevolence	1426	0.34	0.83	-3.00	3.10
Schwartz’s values: Universalism	1426	0.57	0.70	-2.09	3.10
Control Variables:
Age	1438	45.65	14.08	18	82
Female*	1438	55%	--	--	--
Higher education	1438	42%	--	--	--
Take measures to prevent COVID-19 spread	1438	0.77	1.07	0	4
Afraid of getting sick with COVID-19	1438	4.88	1.57	1	7
Scale of COVID-19 in Russia	1438	3.20	1.30	1	5
Personal health evaluation	1435	2.62	0.78	1	5
Attitudes to the government first-wave policy	1438	15.72	5.80	6	30
Watching pro-government news	1420	3.68	2.07	1	6

Note: Dummy variables are marked with an asterisk.

Group means comparisons are summarized in Table 7 and Fig 2. ANOVA showed statistically significant differences between four treatment conditions in the willingness to sacrifice rights (F(3, 1434) = 2.94, p < 0.05, see Table 7, Fig 2), but no differences in the support for restrictive government policies (F(3, 1434) = 0.61, p = 0.608) and criminal liability for quarantine violation (F(3, 1434) = 0.54, p = 0.655). Hence, the effect of risk framing was proven to be statistically significant in 1 of 3 measures of the dependent variable. Pairwise comparisons of experimental conditions and be found in S6 File.

Table 7

Group means of experimental conditions in a completely randomized 2x2 factorial design.

Variable	Individual losses		Losses to others		F
	Low-risk	High-risk	Low-risk	High-risk
Willingness to sacrifice rights	2.89 (1.17)	2.98 (1.19)	2.87 (1.10)	3.09 (1.10)	2.94*
Support for restrictive policy	34.33 (9.79)	35.04 (9.48)	34.22 (9.53)	34.84 (9.18)	0.61
Support for criminal liability	2.25 (1.30)	2.35 (1.30)	2.36 (1.31)	2.31 (1.25)	0.54
N	362	356	346	374

Note: Group means and standard deviations (in brackets) are given in the table. F-statistics are provided in the last column. Significance levels are at

*p<0.05

**p<0.01; ***p<0.001. All tests are two-tailed.

Fig 2

From left to right, the group means with 95% error bars in a) the willingness to sacrifice rights, b) the support for restrictive government policy, and c) the support for criminal liability for quarantine violation.

Compared to Experiment 1, in Experiment 2 we found support of H1 for one measure of the dependent variable only. T-tests showed significant differences in the willingness to sacrifice rights between the low-risk (M = 2.88, SD = 1.13) and high-risk (M = 3.04, SD = 1.15) conditions (t(1436) = -2.631, p < 0.01). Hence, the ATE of risk severity on the willingness to sacrifice rights is 0.16 ([0.04; 0.28]) on a 5-point scale, Cohen’s d = 0.14. However, no other significant differences—either in the support for restrictive government policies (t(1436) = -1.317, p = 0.188) or in the support for criminal liability for the quarantine violation (t(1436) = -0.329, p = 0.742)—were found in the two other measures.

Similarly to Experiment 1 no statistically significant differences—not in the willingness to sacrifice rights (t(1436) = -0.809, p = 0.418), not in the support for restrictive government policies (t(1436) = 0.273, p = 0.785), not in the support for criminal liability for the quarantine violation (t(1436) = -0.540, p = 0.589)—were found between ‘individual losses’ and ‘losses to others’ conditions. So, again there are no grounds for accepting the second hypothesis. We conclude that the object at risk which indicates losses to others does not have a stronger effect on the support for restrictive government policy compared to the personal losses framing.

OLS regression models (see Table 8; see also S7 File) confirm the results of t-tests; the influence of risk severity on the willingness to sacrifice rights is the only main effect which is statistically significant (β = 0.157, p < 0.01). We also estimated interaction effects between main experimental factors. Models 2, 4, and 6 in Table 8 demonstrate that there are no statistically significant interaction effects between risk severity factor and object at risk, neither on willingness to sacrifice rights (β = 0.138, p = 0.250), nor on the support for restrictive government policy (β = -0.085, p = 0.932), nor on the support for criminal liability for the quarantine violation (β = -0.151, p = 0.268).

Table 8

OLS regression models estimates of main effects and interactions; pre-treatment covariates as controls are not included.

	Dependent variable:
	Willingness to sacrifice rights		Support for restrictive government policy		Support for criminal liability
	(1)	(2)	(3)	(4)	(5)	(6)
Intercept	2.858***	2.892***	34.353***	34.331***	2.286***	2.249***
	(0.052)	(0.060)	(0.432)	(0.499)	(0.059)	(0.068)
Factor of Risk Severity: High-Risk	0.157**	0.088	0.662	0.705	0.022	0.097
	(0.060)	(0.085)	(0.501)	(0.708)	(0.068)	(0.096)
Factor of Risk Target: Losses to Others	0.045	-0.025	-0.152	-0.109	0.036	0.113
	(0.060)	(0.086)	(0.501)	(0.714)	(0.068)	(0.097)
High-Risk X Losses to Others		0.138		-0.085		-0.151
		(0.120)		(1.002)		(0.136)
N	1,438	1,438	1,438	1,438	1,438	1,438
Adjusted R2	0.004	0.004	-0.0001	-0.001	-0.001	-0.001
F Statistic	3.743*	2.936*	0.912	0.610	0.196	0.540

Note: Unstandardized beta coefficients are given in the table. Standard errors are in parentheses. Significance levels are at

†p<0.1

*p<0.05

**p<0.01

***p<0.001.

All tests are two-tailed.

Now we proceed with the empirical test of the hypothesis H2a to see if the effect of the ’object at risk’ framing on the support for restrictive government policy is different for the individuals with strong prosocial attitudes. In OLS models (see Table 9) we found a statistically significant interaction effect of the ‘losses to others’ framing and the Schwartz’s value ‘benevolence’, which is defined by the preservation and strengthening of others’ wellbeing [74], in willingness to sacrifice rights (β = 0.158, p < 0.05, Table 9). At 10% significance level, we also found that there is a statistically significant interaction effect of the ‘losses to others’ framing and the Schwartz’s value ‘universalism’—understanding, appreciation, tolerance, and protection for the welfare of all people—on support for restrictive government policies (β = 1.374, p < 0.1). There were no statistically significant moderating effects of either ‘benevolence’ (β = 0.031, p = 0.576) or ‘universalism’ (β = -0.09, p = 0.392) on the support for criminal liability for quarantine violation.

Table 9

OLS regression models estimates of CATEs using values as moderators; pre-treatment covariates as controls are not included.

	Dependent variable:
	Willingness to sacrifice rights		Support for restrictive government policy		Support for criminal liability
	(1)	(2)	(3)	(4)	(5)	(6)
Intercept	2.858***	2.810***	34.337***	34.562***	2.273***	2.338***
	(0.054)	(0.063)	(0.456)	(0.530)	(0.062)	(0.072)
Factor of Risk Severity: High-Risk	0.158**	0.160**	0.729	0.715	0.025	0.025
	(0.060)	(0.060)	(0.504)	(0.503)	(0.068)	(0.068)
Factor of Risk Target: Losses to Others	-0.008	0.003	-0.191	-0.920	0.050	-0.016
	(0.065)	(0.078)	(0.543)	(0.650)	(0.074)	(0.088)
Schwartz’s values: Benevolence	-0.006		-0.049		0.031
	(0.050)		(0.422)		(0.057)
Losses to Others X Benevolence	0.158*		0.078		-0.046
	(0.072)		(0.606)		(0.082)
Schwartz’s values: Universalism		0.076		-0.389		-0.090
		(0.060)		(0.503)		(0.068)
Losses to Others X Universalism		0.085		1.347†		0.084
		(0.086)		(0.719)		(0.098)
N	1,426	1,426	1,426	1,426	1,426	1,426
Adjusted R2	0.009	0.009	-0.001	0.002	-0.002	-0.001
F Statistic	4.104**	4.086**	0.550	1.566	0.189	0.537

Note: Unstandardized beta coefficients are given in the table. Standard errors are in parentheses. Significance levels are at

†p<0.1

*p<0.05

**p<0.01

***p<0.001.

All tests are two-tailed.

Finally, similar to the results of Experiment 1, we found that the participants who were exposed to the ‘low-risk’ framing (M = 2.76, SD = 0.65) were less convinced of the credibility of the information (t(1436) = -4.936, p < 0.001) than those who were in the ‘high-risk group’ (M = 2.92, SD = 0.64); see S8 File for more details. We found that the CATEs of risk severity framing are also higher for those who perceive the treatment information as credible (see S8 File). In other words, Experiment 2 demonstrates empirical evidence of H1 for all three measures of attitudes towards restrictive government policy, but this effect of high vs. low risks is observed only for those who perceive information as credible (see main effects and interactions in Table 10). On the contrary, in Experiment 1 we found that the framing effect was consistent among all respondents, though it was also conditioned by perceived information credibility.

Table 10

Conditional average treatment effects of high-risk vs. low-risk groups.

	Dependent variable:
	Willingness to sacrifice rights	Support for restrictive government policy	Support for criminal liability
Intercept	1.893***	28.779***	1.599***
	(0.223)	(1.758)	(0.227)
Risk Severity: High-Risk	-0.984**	-10.567***	-0.866**
	(0.302)	(2.512)	(0.301)
Perceived credibility	0.358***	1.995***	0.256**
	(0.077)	(0.606)	(0.081)
High-Risk X Perceived credibility	0.370***	3.724***	0.289**
	(0.103)	(0.840)	(0.107)
N	1,438	1,438	1,438
Adjusted R2	0.108	0.084	0.044
F Statistic (df = 3; 1434)	58.968***	45.160***	22.882***

Note: Unstandardized beta coefficients are given in the table. Standard errors are in parentheses. Significance levels are at

p<0.05

p<0.01

p<0.001.

All tests are two-tailed.

Discussion

There are three major findings in this study. First, focusing on higher risks has a positive effect on the support for the government restrictive policy. We found some evidence for the first hypothesis H1, i.e., that high-risk framing caused a higher willingness to sacrifice rights, support for government restrictive measures, and criminal liability. That is in line with the literature on both risk perception of infections and the perception of societal risks which can be a threat to society and social order overall [24-26]. This is also in consistency with health-related behavior theories (e.g., protection motivation theory, health belief model) and the research results which show that those who evaluate health risks as high are more willing to comply with self-protective measures [79]. Our finding also mirrors earlier studies of pandemic impact on social attitudes and behavior. The Ebola outbreak, for instance, was found to produce a stronger support for restrictive policies [80].

At the same time, it should be noted that in terms of effect sizes the differences were small and not always statistically significant. Cohen’s d was up to 0.27 in Experiment 1 and up to 0.16 in Experiment 2. Overall, the participants in both experiments strongly approved a number of restrictive policies. Small effect sizes might result from the fact that the overall level of anxiety and emotional fear (‘affect heuristic’ [21]) of COVID-19 is very high. Significantly more respondents showed a lower level of credibility to the vignettes in the low-risk condition in both experiments. The effect sizes were higher among those who found the information in the vignettes more credible: Cohen’s d was up to 0.34 in Experiment 1 and up to 0.19 in Experiment 2. This result was anticipated, since previous research has shown that individuals seem to perceive lower risk estimates as less credible and consider such information as less trustworthy, especially in health communication [81]. In addition, our result is consistent with the so-called negativity bias effect in processing information [82]. The high-risk condition can be also called a strong frame as it is more compelling for people [33]. That is also elicited by the substantial overestimation of the COVID-19 mortality and infection rates by the respondents in both experiments. The mean mortality rate was evaluated as 11% in Experiment 1 and 35% in Experiment 2. The mean infection rate was evaluated as 31% in Experiment 1 and 56% in Experiment 2. Due to the availability heuristic, when the information about the number of deaths and newly infected people is reported on a daily basis, this increased both infection and mortality rates. This is in accordance with the literature that shows an increase in risk evaluation if the issue is salient for people and if mass media reports the risks on a regular basis [23]. Indeed, the higher individuals evaluated the infection and fatality rates, the more they supported government restrictive policy.

Second, focusing on the losses for others did not produce a stronger support for the restrictive policy compared to focusing on personal losses. This is in line with the papers which found no difference between self-focused and prosocial framing during the COVID-19 pandemic [47, 48, 53, 54]. We found no evidence that prosocial responsibility acts like a Trojan horse for willingness to sacrifice rights and an acceptance of privacy violation [83]. This effect is in line with the idea that people are less inclined to sacrifice for others in a state of uncertainty [84], but contradicts the opposing point of view that people tend to sacrifice if they are exposed to worst-case scenarios [85]. Alongside health and death issues, pandemics might also impact a conservative shift and security demands for oneself [86].

Third, though focusing on the losses for others did not produce a stronger support for restrictive policy, we found a positive moderation effect of such prosocial values as universalism and benevolence. We found that those with prosocial values had a stronger positive effect in the “losses for others” frame and were more willing to support restrictive policy when others were included. This is in line with the prediction of Wolf et al. paper though they showed no empirical evidence of the claim [63]. It seems that proclaiming the importance of being ‘supportive’ and ‘careful’ towards others by WHO, during the pandemic, may increase the support for restrictive policy by some individuals whose values are activated when others are included as those who can be harmed. This is in accordance with the literature that links prosocial values with prosocial risk taking in which there may be a risk for others [45]. This is also in line with the literature on the effect of frames which showed a moderator effect of values. Chong and Druckman [33] emphasize that people’s preferences are a function of personal values and the strength of competing frames on the issue. As a result, some frames should be in consistency with personal values to have an effect on attitudes in a competitive environment.

The effects found in our experimental study reveal both positive and negative aspects in risk communication during the pandemic, which may have a great and long-term impact on trust, attitudes, and behavior. The major positive aspect is the efficiency of risk communication for the awareness of risks and its recognition. Higher perceived risks result in a more risk-averse behavior and higher willingness to undertake protective measures [87].

However, at the same time there might be some negative consequences of this risk communication. First, higher risk perception can undermine social trust, political trust, and trust in scientific experts, if protective measures bring negative consequences to the population or the government is not able to handle the issue [88]. According to the protection motivation theory and health belief model, the perceived effectiveness of recommended measures has an effect on the willingness to follow precautionary actions. If perceived effectiveness is quite low, this can bring a decrease of political trust in government similar to what has happened in Europe after the H1N1 pandemic in 2009 [89]. It was also shown that forced social distance and the social changes caused by the Spanish flu had a long-term negative effect on social trust [90]. Second, a greater loyalty to discretionary power of the executives may seem similar to Slovic’s outlook on the consequences of nuclear risks for democracy [91]. While risk communication produces a high-risk perception of COVID-19, it can be efficient in promoting anti-democratic ideas and messages or the denigration of minorities. Similarly, while including others as those who can be harmed, it can be efficient in promoting support for anti-democratic policies among those who have prosocial values. Thus, there might be growing support for restrictive policy worldwide.

The recent papers published in the Lancet, which argue that ‘we need to pay attention to how authoritarian forces shape our frame of mind’ during the pandemic [92], are a wake-up call for risk communication research. Nevertheless, risk framing and its effects on support for restrictive government policy is critical not just to understand the coercive apparatus of authoritarian government, but to evaluate countries’ ability to conduct risk communication in shaping people’s risk perceptions and instructing them to adopt certain preventive measures, such as social distancing and self-isolation. Overall, we stress the importance of the further exploration of risk communication during the COVID-19 pandemic in different cultures and different population groups, as this has tremendous long-term consequences for all countries.

There are several limitations in this study. First, we cannot make generalizations about Russia since a non-probability sample was used in both experiments. Second, we cannot fully extrapolate our findings to other countries. Both findings can be culturally specific [37]. Russia is a developing country with a certain socio-cultural background and cultural values. Cross-cultural studies should be conducted to explore the differences in risk perception, and the effect of different risk framing on risk perception and the support for restrictive policy. Third, the wording of the vignettes was different in our experiments which make our conclusion about the effect sizes limited, since the change in effect sizes can be due to different wording, but also due to different time points and different survey populations. The effect sizes can also vary in further experiments depending on COVID-19 risk dynamics and media coverage of COVID-19.

In spite of the limitations, our findings confirm the great political importance of risk communication and risk literacy in the time of the pandemic. Gigerenzer [93] shows that risk education and the improvement of risk literacy with regards to staying healthy, should be the focus of institutions, as acting politicians can make ill-advised decisions in the time of crises and pandemics, when long-term consequences of protective measures cannot be examined.

Eligibility and baseline sample characteristics.

(DOCX)

Click here for additional data file.

Randomization checks.

(DOCX)

Click here for additional data file.

CONSORT flow diagrams.

(DOCX)

Click here for additional data file.

Selection and measurement of pre-treatment covariates.

(DOCX)

Click here for additional data file.

DV measurement: support for restrictive government policy.

(DOCX)

Click here for additional data file.

ANOVA post hoc analyses.

(DOCX)

Click here for additional data file.

Results of OLS models.

(DOCX)

Click here for additional data file.

Manipulation checks.

(DOCX)

Click here for additional data file.

References used in supporting information.

(DOCX)

Click here for additional data file.

17 May 2021

PONE-D-21-10676

The effect of risk framing on support for restrictive government policy regarding the COVID-19 outbreak

PLOS ONE

Dear Dr. Chmel,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please find below the reviewers' comments, as well as those of mine.

Please submit your revised manuscript by Jul 01 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Valerio Capraro

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Additional Editor Comments:

I have now collected three reviews from three experts in the field. All reviewers think that this paper has the potential to make a valuable contribution to the literature, but they suggest several improvements before publication. I am myself familiar with the topic of this manuscript, and I agree with the reviewers. Therefore, I would like to invite you to revise your work for Plos One following their suggestions. On top of their comments, I would like to add one more comment from my own reading. I was surprised not to see a discussion of the literature regarding the effect of proself and prosocial messages on pandemic response, which is very relevant to your research, as you also test the effect of framing a message as a loss to self vs others. There are several works that have explored the effect of proself and prosocial messages; these are the ones I know: Banker & Park (2020), Bilancini et al (2020), Capraro & Barcelo (2020), Heffner et al (2020), Lunn et al (2020), Pfattheicher et al (2020) - but it is possible that there are others (please double check). This line of work is very relevant and I think it should be discussed.

I am looking forward for the revision.

References

Banker, S., & Park, J. (2020). Evaluating prosocial COVID-19 messaging frames: Evidence from a field study on Facebook. Judgment and Decision Making, 15(6), 1037-1043.

Bilancini E, Boncinelli L, Capraro V, Celadin T, Di Paolo R (2020) The effect of norm-based messages on reading and understanding COVID-19 pandemic response governmental rules. Journal of Behavioral Economics for Policy 4, Special Issue 1, 45-55.

Capraro, V., & Barcelo, H. (2020). The effect of messaging and gender on intentions to wear a face covering to slow down COVID-19 transmission. Journal of Behavioral Economics for Policy, 4, Special Issue 2, 45-55.

Heffner, J., Vives, M. L., & FeldmanHall, O. (2020). Emotional responses to prosocial messages increase willingness to self-isolate during the COVID-19 pandemic. Personality and Individual Differences, 170, 110420.

Lunn, P. D., Timmons, S., Barjaková, M., Belton, C. A., Julienne, H., & Lavin, C. (2020). Motivating social distancing during the Covid-19 pandemic: An online experiment. Social Science & Medicine, 113478.

Pfattheicher, S., Nockur, L., Böhm, R., Sassenrath, C., & Petersen, M. B. (2020). The emotional path to action: Empathy promotes physical distancing during the COVID-19 pandemic. Psychological Science, 31, 1363-1373.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This study tested the effect of severity of risk description (low vs. high) and object at risk (self vs. others) on people’s attitude toward government restrictive policies. With two experiments at two different stages during the covid pandemic, the study found the severity of risk was consistently significant. On the other hand, the effect of object at risk was moderated by prosocial values.

This study has multiple positive features. Its topic has an important practical implication. The sample size was relatively large. The research questions were tested twice in different stages. The main text was concise but still informative (I like the comprehensive information in the appendix). Overall, I believe the conclusion of this study was supported by its methodology and analyses.

I have a few questions and I hope the authors can clarify.

First, this study tested issue framing and the key manipulation was severity of the risk. Based on my reading of your materials, it seems higher risk condition was associated with more significant losses. As a result, you did find that higher risk led to more positive ratings on the government restrictive policies. Hence, it appears more losses might cause people to take actions to mitigate the spread of the virus (i.e., function of loss aversion). Interestingly, some studies with gain-loss framing found mixed results on the effect of loss aversion (for your reference see a recent study https://psyarxiv.com/4wc5d/ This study also tested risk attitude and political ideology as relevant to your study). While your study did not directly test gain-loss framing, can you still discuss some implications on loss aversion and gain-loss framing based on your findings?

Second, you adopted a typical 2*2 design and I was wondering why you used t-test repeatedly instead of running an anova with post hoc t-tests? Repeat t-test might inflate type I error. Relatedly (I was confused here so hope you can clarify), for your anvoa test, what was the independent variable? For example, you stated “As expected, we found statistically significant differences in the support for restrictivegovernment policy (F(3, 762) = 4.68, p < 0.01, see Table 2, Fig 1) and the support for criminal liability for the quarantine violation (F(3, 762) = 2.72, p < 0.05).” In other words, for these F-tests, which compared to which?

In the main text you stated there was no interaction. However, looking at Figures 1b, 1c, 2a, and 2c, it seems there are interactions between risk severity and object at risk. Did you test these interactions with either anova or OLS?

I like your variable of watching pro-government news. Since two of your dependent variables dealt with government policies, was there an interaction between risk severity and watching pro-government news?

Reviewer #2: Thank you for the opportunity to review this interesting paper about the effect of risk framing on the support for governmental COVID-19 measures in Russia. This study provides some useful tests for the influence of a high risk versus low risk frame as well as the frame of self-protection compared to the responsibility to protect others on the acceptance of coronavirus protection policies. With help of two different survey experiments, the authors show that by framing the coronavirus as risky and dangerous, the willingness to sacrifice some personal rights for the greater good can be increased. In the course of this, they also show the importance of how credible the information is perceived to be. They do not find support for their hypothesis that framing others to be at risk increases the acceptance of restrictive policy measures. However, they mention evidence that people with prosocial attitudes react to the solidarity treatment, and claim to be more willing to sacrifice own rights for the protection of others.

Overall, this survey experiment in Russia provides some interesting and new insights about the acceptance of COVID-19 measures and to what extent the coronavirus support is influenced by different kinds of risk framing. In general, procedure and results are nicely described, there is a great quantity of different analyses and checks, and the study is written very comprehensible. However, there are some aspects that should respectively could be improved - in particular concerning the provision of analyses results and the discussion of the procedure and the results. Since most of the following comments only entail minor revisions, their implementation should be possible without major difficulties.

First, I would like to state one major issue concerning the test of hypothesis 2a that needs to be addressed.

a) Whereas there is plenty of information (such as descriptive tables, t-tests, and randomization and manipulation checks) in the whole paper and in the supporting information, there is a lack of important information concerning the tests of hypothesis 2a. First of all, for better orientation in the paper, it would be helpful, if it is directly mentioned that hypothesis 2a is studied and discussed now (page 17 and/or in the discussion). More important than this is that the analyses and results of H2a, which lead to the conclusions, need to be sufficiently presented. Although the authors mention the OLS models testing H2a, they do not present enough of the model and results (neither in the text nor in the supporting information). For instance, it is not clear if controls had been included and if so which ones. Also, as a reader I would like to look at the main effects, too, and be able to see the whole picture of main effects and the interaction (which can be enlightening and somewhat surprising as in the case of the credibility interaction in Table 5). Because of this, and since the authors promote the interaction of prosocial persons and the willingness to sacrifice own rights for others as a major finding of the study, I think, they have to present the results of the complete OLS models somewhere (at least in the supporting information).

b) Additionally, I missed the presentation of the moderating Schwartz values "Benevolence" and "Universalism" in the supporting information at the randomization checks (chapter B2). However, instead of the moderating variables there is another Schwartz value presented ("Security"), which is not mentioned anywhere else. It would be helpful to be more consistent and more precise about which Schwartz values had been used for which analyses, and why.

c) In experiment 1, I do not fully understand why hypothesis 2a cannot be tested due to too little variation in the moderating variables. What does this mean here and where can this information be found? For instance, the Schwartz values are not presented in the descriptive table here. Does this mean that these variables had not been conducted in the first experiment and therefore included in the second study to test H2a? Alternatively, had all students (more or less) the same attitudes? If there are further results of this topic, which had not been presented yet, it should be considered to provide them – at least in the supporting information.

Second, I want to give some comments on minor issues that could help the authors to improve their paper.

1) Since this study was carried out in Russia, I suggest adding more detailed information about the situation as well as the measures in this country already in the introduction. In the introduction, countries like Sweden and Austria are mentioned, but not Russia, where the experiments had been carried out. As a reader, I would like to know more COVID-19 in Russia. There is even some information about Russia in the cited Gallup poll. [The cited link to the poll does not work anymore. But, here is one that worked for me: https://www.gallup-international.com/fileadmin/user_upload/surveys/2020/GIA_SnapPoll_2020_COVID_Tables_final.pdf

Also, the information from the Gallup poll is from the very beginning of the COVID-19 pandemic. I would also like to see some more recent information – ideally from around the time when the second nationwide experiment took place – because it is possible that the attitudes changed from the first to the second wave. Also, the restrictive policy measures changed over, as we can see in the supporting information. However, some more detailed description in the text would be interesting and could help to develop a better understanding of the situation and the results. So, to me, the chapter "Context of the study, COVID-19 in Russia" could be extended or alternatively included in the introduction.

2) The pre-treatment covariates of both experiments are presented in Table 1 and Table 3. However, most of seem to be a little lost, since they are not mentioned or explained (such as "Scale of COVID-19 in Russia", "Watching pro-government new" or "Take measures to prevent COVID-19 spread"). I see that they are not of main interest in this study, but some further information would be helpful. Why had just these pre-treatment covariates been included, and considered being important for this study? At least in the supporting information there could be further explanation about the purpose and consequences of these variables and their relevance in terms of the two factors of the survey experiment.

3) In the second experiment, the wording of the vignettes – and therefore the treatment of the study – had been changed. The first question that arises here is: Why? Had there been some issues with the vignettes in the first experiment? At the first glance, manipulation checks (supporting information G1) do not suggest to change the vignettes. So, what were the reasons behind this decision? Second, is it possible, that the change of the vignettes affected the results or are the some arguments why this is not likely or why the changing was even necessary? I see, that the results of H1 are somewhat ambivalent (there is less support for H1 in the second experiment). There could be various possible reasons for the differences in the results between experiment 1 and 2. They had been carried out at different points of time (first vs. second wave). The population/sample is not the same (student sample vs. nationwide internet users). The treatment had been changed. I think, that these decisions need to be justified, and their impact and the arising questions should be discussed.

4) Discussion, page 20: Unfortunately, I cannot follow how the authors derive that the support for H1 shows that there is more risk averse behavior in the high-risk framing. As far as I understood the study, it was more an effect of willingness to sacrifice rights and support of restrictive measures than actual risk averse behavior (such as staying at home or reducing meetings with others). So, I would appreciate if the authors would think about their wording here, or could help me understand this conclusion better by some further explanation.

5) There seems to be an issue with the tables in the results part of the second experiment. There are two Table 3 (page 15 and page 16). Table 4 is mentioned in the text on page 18, but the content of this Table 4 is the same as in Table 3 on page 16. So, reading the text, I guess that Table 3 of page 16 is actually Table 4. Table 4 from page 18 can be dropped. Table 5 contains the right information about the credibility interaction. Also, please be aware t hat basically the same section is accidentally included twice ["In other words, the second experiment demonstrates empirical evidence of the H1 for all three measures of attitudes towards restrictive government policy, but the framing effect of high vs. low risks is observed only for those who perceive information as credible (see main effects and interactions in Table 4/5). On the contrary, in the first study we found that the framing effect was consistent among all respondents, though it was also conditioned by the perceived information credibility."; this section can be found on page 18 before "Table 4" and on page 19 after the end of Table 5.]

6) The citation of Trumbo and McComas (2003) is formally not in harmony with the remaining citations. The resource is mentioned on page 20 and in the supporting information. Bur this paper is not listed as a resource; hence, it should be added to the references section.

7) Looking at Figure 2 and reading that there is support for hypothesis 1, it seems that the descriptive statistics of high-risk and low-risk are accidentally interchanged ["… willingness to sacrifice rights between the high-risk (M = 2.88; SD = 1.13) and low-risk (M = 3.04; SD = 1.15) conditions … "] on page 16.

8) Finally, (though somewhat funny) the typo on page 9 – farming instead of framing – should be corrected.

Reviewer #3: Review for PONE-D-21-10676

This paper examines the effects of message framing on support for COVID-related restrictions. Overall while the theoretical contribution is not new, I do believe that the studies provide useful insights into the efficacy of message framing approaches in Russia during the pandemic. My suggestions primarily involve improving the clarity of paper.

- Because there are now a number of published and working papers on the effects of COVID-related message framing, it would help to contextualize the current work by more thoroughly summarizing the related literature.

- In addition, I appreciated the detailed web appendix. However, I feel that it would help to facilitate understanding by moving as much of those details as possible into the main paper so that the reader does not need to refer to the appendix for essential information.

- For example, it was difficult to understand the experimental design without seeing the stimuli. I would recommend moving the vignettes to the main text so that readers understand what is manipulated.

- Were the study and analyses exploratory? If so, this should be stated in the paper.

- Was there a sample size goal? How was the stopping criteria for the study determined?

- In the dependent measures, how were the scale anchors determined? Why was “willingness” measured with a ready/not ready scale? It seems that this wording confuses the acceptance of restrictive measures with the expectation/anticipation of restrictive measures. Please clarify.

- Please explain the high 51% drop-out rate with greater detail (e.g., what was the exact percent of people dropping out on the first page?), were there differences between conditions?

- Statistical details on all test should be reported. For example, I did not find details related to this statement: “The p-values of joint orthogonality tests indicate that the group differences are insignificant, except for probability of COVID-19 infection in the manipulation of the risk severity factor.”

- Please proofread the manuscript for typos. For example on page 9: “The vignettes were structured as the set of rubrics with essentially similar content, yet different farming.” P9

In general, I believe that this paper offers a nice documentation of message framing effects in the Russian context. Adding further detail and clarity to the main text will help to improve the impact of the work.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

30 Jun 2021

Dear Editorial Board,

We thank all three Reviewers and the Editor for their generous comments and suggestions on the manuscript. We have edited the manuscript to address their concerns. For convenience, we put our responses in a file entitled 'Response to Reviewers' and attach it to the submission. In this rebuttal letter we describe the changes made in response to the reviewers’ comments below. We also attach the revised manuscript and the revised version of supplementary materials with highlighted changes.

Please, let us know, if we need to clarify our response or provide it in a different format.

Thank you for your consideration of the manuscript.

Sincerely,

Authors

Submitted filename: Response_to_Reviewers.docx

Click here for additional data file.

22 Jul 2021

PONE-D-21-10676R1

The effect of risk framing on support for restrictive government policy regarding the COVID-19 outbreak

PLOS ONE

Dear Dr. Chmel,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 05 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Valerio Capraro

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

All reviewers are satisfied with the revision and suggest acceptance. I have selected minor revision in the editorial manager just because one of the reviewers noticed that one reference is missing. Please address this comment at your earliest convenience. I am looking forward to receive the final version.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: (No Response)

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: (No Response)

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for your efforts addressing my comments. I am good with the current version. Again, I think the study makes a nice contribution to understand health behaviors in the current pandemic.

Reviewer #2: The authors have responded very well and in detail to my suggestions and questions. The revised sections are enlightening and offer interesting additions. Also, I greatly appreciate the newly created supporting material S4, which is helpful to understand measurement and purpose of the considered pre-treatment covariates. A brief note in this regard: I could not find the references cited in S4, hence, it might be helpful to add them directly at the end of the tables in S4. Overall, the paper has been significantly improved and clarified after revising. Therefore, I support and recommend publication.

Reviewer #3: The authors have adequately addressed all my comments. Thank you for the responsive revision and nice work.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

27 Jul 2021

Dear Editorial Board,

We again thank all three Reviewers and the Editor for their generous comments and suggestions on the manuscript. We have edited the manuscript to address concerns of the Reviewer #2. In this rebuttal letter we describe the changes made in response to the comments. We also attach the revised manuscript and the revised version of supplementary materials with highlighted changes.

Response to the Reviewer #2: The authors have responded very well and in detail to my suggestions and questions. The revised sections are enlightening and offer interesting additions. Also, I greatly appreciate the newly created supporting material S4, which is helpful to understand measurement and purpose of the considered pre-treatment covariates. A brief note in this regard: I could not find the references cited in S4, hence, it might be helpful to add them directly at the end of the tables in S4. Overall, the paper has been significantly improved and clarified after revising. Therefore, I support and recommend publication.

We thank the Reviewer for careful reading of the manuscript and the particular attention to the Supporting information. Thanks to this comment, we noticed that there are no references listed for the Supporting information. To address this issue, we updated the Supporting information and added one more file - S9 File – in which the references used in the Supporting information are listed.

Response to the Editor: All reviewers are satisfied with the revision and suggest acceptance. I have selected minor revision in the editorial manager just because one of the reviewers noticed that one reference is missing. Please address this comment at your earliest convenience. I am looking forward to receiving the final version.

We thank the Editor for the opportunity to revise again the manuscript. We made sure that the References section is complete and added to the Supporting information another file in which the references used in the Supporting information are listed.

Thank you for your consideration of the manuscript.

Sincerely,

Authors

Submitted filename: Response_to_Reviewers.docx

Click here for additional data file.

21 Sep 2021

The effect of risk framing on support for restrictive government policy regarding the COVID-19 outbreak

PONE-D-21-10676R2

Dear Dr. Kirill Chmel,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Akihiro Nishi, M.D., Dr.P.H.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

I am happy to see that the two reviewers are satisfied with the quality of the work.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I recommended accept in the last round. The minor change in the latest round did not change my decision.

Reviewer #2: Dear Authors

Thank you for including the references of the Supporting Information in an additional file (S9). All concerns have been very well addressed. Therefore, I support and recommend publication.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

24 Sep 2021

PONE-D-21-10676R2

The effect of risk framing on support for restrictive government policy regarding the COVID-19 outbreak

Dear Dr. Chmel:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Akihiro Nishi

Academic Editor

PLOS ONE