Literature DB >> 33164802

The sources and correlates of exposure to vaccine-related (mis)information online.

Andrew M Guess1, Brendan Nyhan2, Zachary O'Keeffe3, Jason Reifler4.   

Abstract

OBJECTIVES: To assess the quantity and type of vaccine-related information Americans consume online and its relationship to social media use and attitudes toward vaccines.
METHODS: Analysis of individual-level web browsing data linked with survey responses from representative samples of Americans collected between October 2016 and February 2019.
RESULTS: We estimate that approximately 84% of Americans visit a vaccine-related webpage each year. Encounters with vaccine-skeptical content are less frequent; they make up only 7.5% of vaccine-related pageviews and are encountered by only 18.5% of people annually. However, these pages are more likely to be published by untrustworthy sources. Moreover, skeptical content exposure is more common among people with less favorable vaccine attitudes. Finally, usage of online intermediaries is frequently linked to vaccine-related information exposure. Google use is differentially associated with subsequent exposure to non-skeptical content, whereas exposure to vaccine-skeptical webpages is associated with usage of webmail and, to a lesser extent, Facebook.
CONCLUSIONS: Online exposure to vaccine-skeptical content is relatively rare, but vigilance is required given the potential for exposure among vulnerable audiences.
Copyright © 2020 Elsevier Ltd. All rights reserved.

Entities:  

Keywords:  Information; Online; Search; Social media; Vaccine hesitancy; Vaccine skepticism

Mesh:

Substances:

Year:  2020        PMID: 33164802      PMCID: PMC7578671          DOI: 10.1016/j.vaccine.2020.10.018

Source DB:  PubMed          Journal:  Vaccine        ISSN: 0264-410X            Impact factor:   3.641


Introduction

Vaccine hesitancy, which has been named one of the top ten threats to global health by the World Health Organization [33], threatens to exacerbate the spread of communicable diseases in the U.S. and around the world. Many scholars identify the internet and social media as important vectors for the spread of information questioning the safety and effectiveness of vaccines, citing webpages (e.g., [35], [20], [1], [21], [23], [19]), search engines such as Google (e.g., [32], [28], [11]), content sharing sites such as YouTube (e.g., [22], [4], [9]]), and social media sites such as Facebook and Twitter (e.g., [3], [6], [16], [17], [29]) as key platforms for its dissemination. Exposure to this type of dubious content may worsen people’s attitudes toward vaccines and be difficult to refute (e.g., [2], [18], [8], [25]) — an especially important risk to understand in the context of expected future vaccines during the global COVID-19 pandemic. Analyses that have been conducted to date overwhelmingly focus on the supply of online (mis)information about vaccines or the effects of exposure to that information. By comparison, relatively little is known about the vaccine information people actually consume online and its relationship to both their attitudes toward the topic and the communication formats and platforms that they use. To effectively address the problem of vaccine hesitancy, it is essential to learn what vaccine-related information people actually see online and the means by which they are exposed to it. To do so, we conduct the most systematic measurement to date of vaccine-related information exposure online in the United States, analyzing survey and linked online behavioral data from seven large nationally representative samples collected from late 2016 to early 2019. These data allow us to measure how much vaccine information is consumed online, what proportion of it is skeptical toward vaccines, and to examine how these consumption patterns relate to both people’s attitudes toward vaccines and their social media usage. Our analyses consider three specific concerns about vaccine information online. First, we evaluate the quantity and type of vaccine-related information people consume online to identify how much of it is skeptical about the safety and efficacy of vaccines. Second, we consider the relationship between people’s attitudes or beliefs toward vaccines and the information they consume online. Many observers fear that people with strong views or misinformed beliefs will become trapped in “echo chambers” of like-minded sources online [30]. Though behavioral evidence suggests these fears are overstated [15], [14], [13], little is known about the extent of selective exposure to online information about vaccines. Finally, we consider the role of social media platforms, search engines, and email in exposure to vaccine-related webpages and the extent to which their use is associated with the consumption of vaccine-skeptical information.

Methods

We analyze the contents and correlates of people’s online exposure to vaccine-related information using survey responses linked with individual-level behavioral data detailing the websites that people visit. Our data come from seven nationally representative surveys we conducted among U.S. adults between October 2016 and February 2019 via the survey company YouGov. The data included survey responses as well as web browsing behavior data from the period around the survey, which was collected from participants with their informed consent. We analyze responses to the surveys for which corresponding behavioral data is available. We also analyze the relationship between behavioral data and vaccine attitudes among the subset of respondents for whom prior survey measures of vaccine attitudes are available. The attitude data uses the mean response (adjusted for direction) to a ten-question battery adapted from Freed et al. [10] (see Online Appendix A for wording). These data were collected by one of the authors (Reifler) from a subset of respondents in separate surveys conducted from October 2–30, 2014 and July 30–September 28, 2015. Mean responses are calculated by respondent and include responses to both scales where available; “don’t know” responses are treated as missing. The behavioral data we observe consists of a stream of URLs visited by respondents on their desktop and laptop computers during the period around each of the national surveys. These data come from YouGov survey panelists who, in addition to participating in surveys, have consented to also provide behavioral data for additional incentives. These data are linked by the vendor to these respondents’ survey data and provided to researchers for an additional fee. The data provided by the vendor to the researchers is anonymized. We identify vaccine-related information from visited URLs using keyword filtering and human coding (see the Online Appendix A for a more detailed description). First, we attempted to scrape (i.e., extract) the text of the URLs that respondents visited during the periods in which we observe their online behavior. (Pages that were not available were likely either expired links or query results that we could not access.) Among the 74% of unique URLs whose text could be successfully scraped, we then identified all pages visited by respondents in which words with the stem “vacc” appeared three or more times in the text (a total of 3,508 unique URLs). Finally, we coded each of these pages for whether the information it provided about vaccines is skeptical about their safety and efficacy or not, which we refer to below as “vaccine-skeptical” or “not vaccine-skeptical.” The coding protocol we employed (provided in the Online Appendix A) was developed inductively while reviewing pages from domains likely to contain vaccine-relevant content. After it was developed, an author and a research assistant then used the coding protocol to jointly classify a random subset of 100 documents as vaccine-skeptical or not; intercoder agreement was 100%. The research assistant then manually coded the remainder of the documents identified by the keyword filtering process. Following Guess, Nyhan and Reifler [14], we then combine the URL exposure data and set of coded vaccine URLs to create two outcome measures for each survey respondent using the behavioral data associated with their survey response. First, we calculate binary indicators of whether they visited one or more vaccine-skeptical webpages and/or one or more non-skeptical webpages during the period around the survey. We also create count variables measuring how many pages of each type that they visited during the period in question. Finally, we assess the quality of these webpages using the list of untrustworthy websites compiled by Grinberg et al. [12] and the prevalence of .gov and .edu domains. We use these data to better understand the process by which people encounter online content about vaccines. Though it is not possible to measure on-platform behavior directly, we estimate the prevalence of visits to prominent social media, email, and search websites immediately prior to visiting a vaccine-related webpage (i.e., if those sites were visited in the prior 30 s and were among the three preceding URLs). We follow an analogous approach to measure platform use immediately after a visit. We supplement this analysis by measuring visits to the Facebook pages of prominent anti-vaccine groups, an important potential source of vaccine skepticism (e.g., [7]). We construct a list of 22 of the most important anti-vaccine Facebook groups based on reporting by journalists and an analysis of anti-vaccine advertisers on Facebook [5], [17], [24], [26], [31], [34]. We estimate linear regression models using ordinary least squares, pooling data across waves (i.e., combining responses from multiple surveys). Because some individuals participated in multiple surveys, it would be incorrect to treat each observation as statistically independent; we therefore use clustered standard errors to account for within-individual correlations in survey responses. In addition, we include panel fixed effects to account for any time-specific differences between survey waves. Finally, we apply survey weights constructed by YouGov so that the characteristics of our sample resemble those of the U.S. population to the maximum extent possible. (Corresponding models without survey weights are reported in the Online Appendix A; generalized linear models are not estimated due to perfect separation in logistic regression models. Replication data and code will be made available online upon publication of this article.)

Results

Respondent characteristics

We analyze behavior data from 7320 unique individuals who participated in one or more of the YouGov surveys we conducted between October 2016 and February 2019. These individuals represent 7320 of the 12,017 unique individuals in our survey data and provided 13,494 of the 19,308 observed responses. We observe an average of 26.6 days of behavioral data per respondent among those for whom web traffic data is available. Table 1 provides specific fielding dates, sample sizes, and demographic characteristics of the participants for whom behavioral data is available and compares them to the full set of survey respondents. In general, the set of respondents for whom behavioral data are available is virtually indistinguishable from the total pool of survey respondents on observable demographic measures such as sex, education, race, parental status, party, and age.
Table 1

Participant demographics by sample.

Oct.–Nov.Oct.–Nov.June–JulyJuly–Aug.Oct.–Nov.Nov.–Jan.Jan.–MarchFullWebVaccine
2016201720182018201820192019sampledataattitudes
Male47.6%47.6%48.1%48.8%48.3%48.7%48.4%48.2%47.9%51.9%
College29.2%27.2%30.2%29.3%29.0%28.8%29.6%29.0%29.8%20.0%
White68.2%69.1%64.9%65.2%64.6%64.1%65.2%65.7%67.9%61.2%
Parent26.3%28.4%22.8%20.7%27.5%26.6%24.5%25.7%23.9%21.1%
Democrat37.2%34.6%38.4%38.4%39.5%36.4%34.9%37.1%37.8%36.2%
Repub.26.1%25.0%27.4%26.0%26.5%26.8%28.0%26.5%26.3%23.5%
Median age58455457555055545555
N325121001718200033324907200019,30813,4941250



Dates of data collection (mm/dd)
Surveys10/21–10/3111/2–11/86/25–7/247/26–7/3010/19–10/2411/20–12/282/6–2/25
Web data10/7–11/1410/25–11/226/11–7/317/12–8/210/5–11/511/12–1/161/24–3/11

All population proportions are calculated using sample weights except for age. Partisan statistics do not include respondents who report leaning toward one party. Vaccine attitudes data include only responses for which corresponding online behavior data is also available.

Participant demographics by sample. All population proportions are calculated using sample weights except for age. Partisan statistics do not include respondents who report leaning toward one party. Vaccine attitudes data include only responses for which corresponding online behavior data is also available. We also measure prior vaccine attitudes for 1250 respondents for whom such measures are available. For this measure, the sample mean is 3.88 on a 1–5 scale where 5 indicates the most positive view of vaccines. For presentational purposes, we categorize respondents into three equally sized groups using a tercile split. The tercile of Americans whom we describe as having the “most favorable” vaccine attitudes has a mean response of 4.69; the middle tercile (which we call “somewhat favorable”) has a mean of 4; and the lowest tercile (which we call “least favorable”) has a mean of 2.95. The points of division between the groups are 3.61 and 4.37, which represent approximately the 33th and 67th percentiles of the vaccine attitudes distribution.

Prevalence and content of online vaccine information exposure

Our data indicate that 12.6% of respondents were exposed to at least one vaccine-related webpage during the period for which behavioral data is available. Assuming that exposure rate is uniform over time and respondents, it is equivalent to an annualized rate of 84% given the mean number of days of behavioral data we observe per response (26.59; see Online Appendix A for details on how we calculate this quantity). In other words, at the rate of exposure found in our data, we expect that most Americans are exposed to at least one vaccine-related webpage per year. However, exposure rates vary dramatically between vaccine-skeptical content and other types of vaccine-related information. We find that just 1.48% of respondents visited a vaccine-skeptical webpage during the periods when behavioral data was being recorded, which is equivalent to an annualized rate of 18.5% given the mean number of days of behavioral data we observe. By contrast, the frequency of exposure to non-skeptical content is much higher — approximately 11.76% of respondents visited a webpage that was not classified as skeptical when behavioral data was being recorded, which is equivalent to an annualized rate of 82%. The volume of consumption of webpages related to vaccines is similarly skewed toward non-skeptical content. In total, 92.5% of the related pages that respondents viewed were not skeptical about vaccine safety or efficacy. Visits to vaccine-related webpages are not common; the distribution is instead heavily skewed due to high levels of exposure among a small subset of respondents. In the period of observation, the percentile of exposure to vaccine-skeptical content for an individual respondent is one page and the maximum is 72 pages. Similarly, the percentile of observed exposure to non-skeptical vaccine content is 3 pages, the percentile is 10 pages, and the maximum is 249 pages. Which sites with vaccine-related content are people visiting? Table 2 lists the top non-vaccine-skeptical (left column) and vaccine-skeptical (right column) web domains in our data. Wikipedia dominates the non-skeptical list with 230 visits total from our sample, followed by the Centers for Disease Control’s CDC.gov with 64 visits. Also prominent on the list are trustworthy medical sites (Mayo Clinic, WebMD), mainstream news sources (New York Times, Axios, National Public Radio), and Petco, which is a source of information about pet vaccines. The vaccine-skeptical sources appear to be a combination of sites purporting to offer news and information about natural health (e.g., Mercola), blogging platforms where anyone can post (e.g., Wordpress), and untrustworthy news websites (e.g., YourNewsWire), though they also include general sites with news and opinion (e.g., azcentral.com).
Table 2

Top domains for vaccine content.

Non-skeptical webpages
Vaccine-skeptical webpages
DomainNDomainN
wikipedia.org230mercola.com34
cdc.gov64collective-evolution.com32
isidewith.com63naturalnews.com15
webmd.com57healthimpactnews.com6
mayoclinic.org51greenmedinfo.com5
nytimes.com40guacamoley.com5
axios.com39wordpress.com5
nih.gov38betrayalseries.com4
petco.com32boredpanda.com4
npr.org28deeprootsathome.com4
cnn.com24nvic.org4
medicinenet.com24vaccineimpact.com4
latimes.com21yournewswire.com4
nbcnews.com20azcentral.com3
healthline.com16democracynow.org3

Number of visits to vaccine-skeptical and non-skeptical webpages by domain in web tracking data.

Top domains for vaccine content. Number of visits to vaccine-skeptical and non-skeptical webpages by domain in web tracking data. To more systematically characterize the differences in informational quality between vaccine-skeptical and non-skeptical content, we measure the difference in the prevalence of websites that Grinberg et al. [12] identify as untrustworthy among the vaccine-related webpages that Americans visit. In total, we find that 21.5% of pageviews of vaccine-skeptical content come from sites that have been specifically identified as unreliable compared to only 0.2% among the non-skeptical content. Similarly, 12.4% of pageviews of non-skeptical content went to .gov or .edu domains (where informational quality is likely higher on average) compared to 0.8% for skeptical content.

Relationship between vaccine attitudes and information exposure

Do people seek out vaccine information that is consistent with their attitudes toward vaccines? Using prior measures of vaccine attitudes, we can see in Fig. 1 whether rates of exposure to skeptical and non-skeptical content vary by the vaccine attitudes measured in our surveys. We find a negligible difference in the overall share of visits to vaccine-skeptical pages by vaccine attitudes: 0.77% among respondents with the least favorable attitudes toward vaccines (those in the lowest tercile in the vaccine scale) compared to 0.89% among those who have the most favorable attitudes (those in the highest tercile). However, the difference is more stark for visits to non-skeptical vaccine content — nearly 19% of respondents with the most favorable attitudes toward vaccines were exposed to one or more vaccine-related webpages that were not skeptical about the safety or efficacy of vaccines compared to just 8% of respondents with the least favorable attitudes. In other words, people with more favorable attitudes toward vaccines were relatively more likely to be exposed to less skeptical information about the topic, which could be the result of people with more favorable attitudes seeking pro-attitudinal information, people with less favorable attitudes avoiding counter-attitudinal information, or some combination of the two (our data do not allow us to distinguish between these possibilities). This finding holds when we estimate a series of linear regressions controlling for demographic characteristics (Table 3 ).
Fig. 1

Relationship between vaccine attitudes and online information exposure. Means incorporating survey weights with 95% confidence intervals. Vaccine attitudes measured on a 5-point scale and split into terciles. Online information exposure measured as binary indicators for visits to at least one webpage (left) and number of webpage visits (right). Webpage information content coded for vaccine skepticism among pages with 3 or more mentions of vaccine-related keywords (see Online Appendix A for details on coding protocol).

Table 3

Correlates of exposure to online vaccine-related information (behavioral data).

Non-skeptical webpages
Vaccine-skeptical webpages
Visited 1 pageTotal pages visitedVisited 1 pageTotal pages visited
College0.020∗0.0270.0290.2750.001−0.0080.003−0.059
graduate(0.008)(0.035)(0.107)(0.270)(0.003)(0.006)(0.015)(0.045)
Female0.002−0.0140.0090.0600.0030.0120.0240.077
(0.009)(0.029)(0.110)(0.174)(0.003)(0.007)(0.017)(0.045)
Nonwhite−0.038∗∗∗0.007−0.1250.105−0.009∗∗−0.017∗∗−0.028∗−0.085
(0.010)(0.033)(0.124)(0.213)(0.003)(0.006)(0.014)(0.050)
Age 30–44−0.063∗∗∗−0.122∗−0.757∗∗−0.839−0.009−0.002−0.0320.019
(0.016)(0.058)(0.236)(0.515)(0.005)(0.004)(0.021)(0.040)
Age 45–59−0.065∗∗∗−0.088−0.925∗∗∗−1.021∗−0.0030.002−0.036−0.030
(0.017)(0.059)(0.232)(0.507)(0.006)(0.004)(0.021)(0.033)
Age 60+−0.081∗∗∗−0.034−1.031∗∗∗−0.875−0.0050.012−0.0030.017
(0.017)(0.062)(0.247)(0.533)(0.005)(0.006)(0.028)(0.032)
Parent−0.0140.007−0.0340.042−0.0020.0120.0030.088
(0.010)(0.034)(0.109)(0.272)(0.003)(0.009)(0.011)(0.078)
Days in0.002∗∗∗0.0030.0110.0010.0000.000−0.0010.001
panel(0.000)(0.002)(0.006)(0.008)(0.000)(0.000)(0.000)(0.001)
log(URLs0.021∗∗∗0.0190.152∗∗∗0.192∗0.005∗∗∗0.0020.021∗∗∗0.023
visited)(0.002)(0.010)(0.028)(0.084)(0.001)(0.001)(0.005)(0.017)
Vaccine0.047∗∗0.1460.000−0.034
favorability(0.016)(0.115)(0.004)(0.028)
Constant−0.002−0.1630.053−1.012−0.010−0.029−0.060−0.129
(0.026)(0.108)(0.296)(0.613)(0.008)(0.023)(0.040)(0.104)



R20.0670.1010.0270.0660.0140.0290.0040.024
N12,835117712,835117712,835117712,8351177

(two-sided); OLS models with standard errors clustered by respondent and survey weights applied. All models include panel fixed effects. Data from YouGov panel participants with online traffic data available. Each observation represents behavioral web traffic data associated with responses to one of seven national surveys conducted from 2016–2019. Vaccine attitudes data were collected in prior surveys among a subset of respondents.

Relationship between vaccine attitudes and online information exposure. Means incorporating survey weights with 95% confidence intervals. Vaccine attitudes measured on a 5-point scale and split into terciles. Online information exposure measured as binary indicators for visits to at least one webpage (left) and number of webpage visits (right). Webpage information content coded for vaccine skepticism among pages with 3 or more mentions of vaccine-related keywords (see Online Appendix A for details on coding protocol). Correlates of exposure to online vaccine-related information (behavioral data). (two-sided); OLS models with standard errors clustered by respondent and survey weights applied. All models include panel fixed effects. Data from YouGov panel participants with online traffic data available. Each observation represents behavioral web traffic data associated with responses to one of seven national surveys conducted from 2016–2019. Vaccine attitudes data were collected in prior surveys among a subset of respondents.

Originators of online vaccine information

Following prior research on news intermediaries and incidental exposure, we explore the pathways by which people arrive at vaccine-related information online. Given concerns about the role of social media and especially Facebook in spreading vaccine skepticism and misinformation, one possible approach is to consider the association between Facebook usage and exposure to vaccine-skeptical information. In the Online Appendix A, we show that Facebook usage is associated with greater exposure to vaccine-skeptical websites conditional on basic demographic and online behavior covariates. However, this correlational approach cannot rule out the possibility that vaccine skepticism encourages greater Facebook use or that the relationship is an artifact of confounding by unobservables. We therefore take a different approach that better leverages our behavioral data on online browsing behavior. Following Guess, Nyhan and Reifler [14], we compute the proportion of visits to prominent online intermediaries immediately before and after visits to vaccine-related or other types of websites. This approach allows us to infer the relationship between usage of these platforms and exposure to vaccine-related content. Fig. 2 breaks down the proportion of exposures to non-vaccine-skeptical webpages (light gray), vaccine-skeptical webpages (dark gray), or neither (black) that followed or preceded visits to Facebook (the most important social media platform), Google (the dominant search engine), and webmail services such as Gmail, Hotmail, and Yahoo Mail. (We provide an equivalent figure including Bing and Twitter in the Online Appendix A.).
Fig. 2

Frequency of pre- and post-visit exposure to social media, search, and email. Share of exposure to pages coded as vaccine-skeptical, not vaccine-skeptical, or not vaccine-related that followed (left panel) or preceded (right panel) visits to Facebook, Google, or webmail. Webpage information content coded for vaccine skepticism among pages with 3 or more mentions of vaccine-related keywords (see Online Appendix A for details on coding protocol). Sites were identified as having been visited immediately prior to or after exposure if they were among the three visits before or after a given URL and if they appeared within 30 s of webpage exposure.

Frequency of pre- and post-visit exposure to social media, search, and email. Share of exposure to pages coded as vaccine-skeptical, not vaccine-skeptical, or not vaccine-related that followed (left panel) or preceded (right panel) visits to Facebook, Google, or webmail. Webpage information content coded for vaccine skepticism among pages with 3 or more mentions of vaccine-related keywords (see Online Appendix A for details on coding protocol). Sites were identified as having been visited immediately prior to or after exposure if they were among the three visits before or after a given URL and if they appeared within 30 s of webpage exposure. The left panel of Fig. 2 shows that Google appears to play an outsize role in promoting exposure to non-skeptical content. Visits to Google immediately preceded 11.2% of visits to non-skeptical webpages related to vaccines compared with 6.3% of vaccine-skeptical webpages and 3.1% of unrelated content. (The most frequent search terms we observe and their frequency are listed in the Online Appendix A.) By contrast, we observe suggestive evidence of greater use of webmail sites such as Gmail immediately prior to visits to vaccine-skeptical webpages. In total, approximately 7.9% of vaccine-skeptical webpages were immediately preceded by visits to webmail sites compared to 3.8% of non-skeptical webpages (and 9.9% of unrelated webpages). Finally, we observe only modest evidence that Facebook use is associated with visits to vaccine-skeptical content. Specifically, 5.1% of visits to vaccine-skeptical webpages were immediately preceded by visits to Facebook compared to 2.8% of non-skeptical webpages (and 3.5% of unrelated webpages). The right panel of Fig. 2 presents a parallel analysis of visits to Facebook, Google, and webmail after exposure to vaccine-related webpages. We find that Google use is greatly diminished immediately after exposure to non-skeptical webpages compared to immediately before (4.9% compared to 11.2%), suggesting that it predominantly acts as a gateway to non-skeptical content. Patterns of Facebook and webmail use are more similar before and after exposure, suggesting that respondents may switch back and forth between these sites and specific pages. We buttress the evidence above by analyzing visits to the Facebook pages of prominent anti-vaccine groups and groups that publish anti-vaccine ads on Facebook (see the Online Appendix A for the list of groups). Though we cannot observe the contents of respondents’ news feeds, we only observe 11 respondents out of 13,494 visiting a page associated with one of these groups in their desktop or laptop web browser (i.e., loading a URL in which the group name or its Facebook ID appears in the URL of a public page or public post by the group). Only one respondent in our data visited more than three such pages from anti-vaccine Facebook groups.

Discussion

Our analysis of more than 134 million pageviews by our participants shows that visits to webpages that are skeptical of the safety and efficacy of vaccines are relatively uncommon. We estimate that only 18.5% of Americans visit one or more vaccine-skeptical webpages per year at an annualized rate. These skeptical webpages are more likely to be published by untrustworthy websites. Moreover, exposure rates are higher among people with the least favorable attitudes toward vaccines. Among this group, more than 18% of pageviews go to skeptical webpages compared to only 2% among people with the most favorable attitudes. Finally, we analyze the roles of social media, email, and search engines in promoting exposure to vaccine-related information. Our results indicate that Google is an especially important gateway to non-skeptical vaccine content and that exposure to vaccine-skeptical content appears differentially associated with webmail use and, to a lesser extent, Facebook use. These results indicate that both prior attitudes and online information sources play an important role in the online information that Americans consume about vaccines, providing an important pre-COVID baseline for the amount and type of vaccine information that people consume online. Nonetheless, we face important limitations in our data that should be noted. First, we cannot observe respondent activity before, after, or between the data collection periods for our studies. Second, it is not possible for us to directly observe respondent exposure to information on Facebook or Twitter or on mobile devices. Mobile web tracking data is limited to domains only, preventing us from replicating our article-level coding procedure for those devices. In addition, mobile data is typically only available for a small share of tracking samples [14]. Future research should seek to fill in these gaps with more fine-grained data (e.g., [27]). Third, we cannot measure exposure to information on mobile web browsers or within applications. Fourth, we lack data on our respondents’ offline information exposure or social connections, which may differ from what they consume online. Finally, our data do not extend to the COVID-19 pandemic; future research should examine online information consumption once a vaccine for the novel coronavirus vaccine is approved and widespread vaccination campaigns begin. We also acknowledge potential limitations in our analytical approach. We relied on a keyword search and manual coding procedure that is feasible on a dataset with millions of observations and that allows us to achieve high face validity and intercoder reliability. However, this approach does not allow us to reliably measure every brief, subtle, or context-specific reference to vaccines. Despite those limitations, our results identify unfulfilled opportunities for platforms to promote accurate information about vaccines. Incidental exposure to non-skeptical information about vaccines currently appears to be quite rare; many visits to non-skeptical pages appear to originate either from Google searches for vaccine-related information or purposeful visits to specific websites. Platforms could better promote incidental exposure to accurate information (e.g., via Facebook’s COVID-19 Information Center or Google’s COVID-19 information dashboard). We must also remain vigilant in monitoring the quality of vaccine-related information on the online platforms that now shape Americans’ information diets, especially as COVID-19 vaccine candidates approach regulatory approval.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
  24 in total

1.  Sorting through search results: a content analysis of HPV vaccine information online.

Authors:  Kelly Madden; Xiaoli Nan; Rowena Briones; Leah Waks
Journal:  Vaccine       Date:  2011-10-19       Impact factor: 3.641

2.  Opportunities and challenges of Web 2.0 for vaccination decisions.

Authors:  Cornelia Betsch; Noel T Brewer; Pauline Brocard; Patrick Davies; Wolfgang Gaissmaier; Niels Haase; Julie Leask; Frank Renkewitz; Britta Renner; Valerie F Reyna; Constanze Rossmann; Katharina Sachse; Alexander Schachinger; Michael Siegrist; Marybelle Stryk
Journal:  Vaccine       Date:  2012-02-22       Impact factor: 3.641

3.  The influence of vaccine-critical websites on perceiving vaccination risks.

Authors:  Cornelia Betsch; Frank Renkewitz; Tilmann Betsch; Corina Ulshöfer
Journal:  J Health Psychol       Date:  2010-04

4.  Vaccination or immunization? The impact of search terms on the internet.

Authors:  Robert M Wolfe; Lisa K Sharp
Journal:  J Health Commun       Date:  2005-09

5.  YouTube as a source of information on immunization: a content analysis.

Authors:  Jennifer Keelan; Vera Pavri-Garcia; George Tomlinson; Kumanan Wilson
Journal:  JAMA       Date:  2007-12-05       Impact factor: 56.272

6.  A postmodern Pandora's box: anti-vaccination misinformation on the Internet.

Authors:  Anna Kata
Journal:  Vaccine       Date:  2009-12-30       Impact factor: 3.641

7.  'Should I vaccinate my child?' comparing the displayed stances of vaccine information retrieved from Google, Facebook and YouTube.

Authors:  Lucy E Elkin; Susan R H Pullon; Maria H Stubbe
Journal:  Vaccine       Date:  2020-02-25       Impact factor: 3.641

8.  Vaccine-related advertising in the Facebook Ad Archive.

Authors:  Amelia M Jamison; David A Broniatowski; Mark Dredze; Zach Wood-Doughty; DureAden Khan; Sandra Crouse Quinn
Journal:  Vaccine       Date:  2019-11-13       Impact factor: 3.641

9.  Effective messages in vaccine promotion: a randomized trial.

Authors:  Brendan Nyhan; Jason Reifler; Sean Richey; Gary L Freed
Journal:  Pediatrics       Date:  2014-03-03       Impact factor: 7.124

10.  Parents' source of vaccine information and impact on vaccine attitudes, beliefs, and nonmedical exemptions.

Authors:  Abbey M Jones; Saad B Omer; Robert A Bednarczyk; Neal A Halsey; Lawrence H Moulton; Daniel A Salmon
Journal:  Adv Prev Med       Date:  2012-10-02
View more
  10 in total

1.  Sociopolitical and psychological correlates of COVID-19 vaccine hesitancy in the United States during summer 2021.

Authors:  Justin Stoler; Casey A Klofstad; Adam M Enders; Joseph E Uscinski
Journal:  Soc Sci Med       Date:  2022-06-06       Impact factor: 5.379

2.  Would Parents Get Their Children Vaccinated Against SARS-CoV-2? Rate and Predictors of Vaccine Hesitancy According to a Survey over 5000 Families from Bologna, Italy.

Authors:  Marco Montalti; Flavia Rallo; Federica Guaraldi; Lapo Bartoli; Giulia Po; Michela Stillo; Paola Perrone; Lorena Squillace; Laura Dallolio; Paolo Pandolfi; Davide Resi; Maria Pia Fantini; Chiara Reno; Davide Gori
Journal:  Vaccines (Basel)       Date:  2021-04-10

3.  The Model of "Informed Refusal" for Vaccination: How to Fight against Anti-Vaccinationist Misinformation without Disregarding the Principle of Self-Determination.

Authors:  Stefano D'Errico; Emanuela Turillazzi; Martina Zanon; Rocco Valerio Viola; Paola Frati; Vittorio Fineschi
Journal:  Vaccines (Basel)       Date:  2021-02-01

4.  How does information overload about COVID-19 vaccines influence individuals' vaccination intentions? The roles of cyberchondria, perceived risk, and vaccine skepticism.

Authors:  Andreawan Honora; Kai-Yu Wang; Wen-Hai Chih
Journal:  Comput Human Behav       Date:  2022-01-04

5.  A retrospective analysis of social media posts pertaining to COVID-19 vaccination side effects.

Authors:  Max-Philipp Lentzen; Viola Huebenthal; Rolf Kaiser; Matthias Kreppel; Joachim E Zoeller; Matthias Zirk
Journal:  Vaccine       Date:  2021-11-22       Impact factor: 3.641

6.  COVIDiSTRESS diverse dataset on psychological and behavioural outcomes one year into the COVID-19 pandemic.

Authors:  Angélique M Blackburn; Sara Vestergren
Journal:  Sci Data       Date:  2022-06-21       Impact factor: 8.501

7.  Effectiveness of Social Video Platforms in Promoting COVID-19 Vaccination Among Youth: A Content-Specific Analysis of COVID-19 Vaccination Topic Videos on Bilibili.

Authors:  Hao Gao; Hao Yin; Li Peng; Han Wang
Journal:  Risk Manag Healthc Policy       Date:  2022-09-01

Review 8.  Cause and effect: On the antecedents and consequences of conspiracy theory beliefs.

Authors:  Joseph Uscinski; Adam M Enders; Casey Klofstad; Justin Stoler
Journal:  Curr Opin Psychol       Date:  2022-05-28

9.  The dramatic increase in anti-vaccine discourses during the COVID-19 pandemic: a social network analysis of Twitter.

Authors:  Nihal Durmaz; Engin Hengirmen
Journal:  Hum Vaccin Immunother       Date:  2022-02-03       Impact factor: 3.452

10.  Testing the validity of the modified vaccine attitude question battery across 22 languages with a large-scale international survey dataset: within the context of COVID-19 vaccination.

Authors:  Hyemin Han
Journal:  Hum Vaccin Immunother       Date:  2022-02-01       Impact factor: 3.452

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.