{"id":8873,"date":"2021-09-20T14:30:15","date_gmt":"2021-09-20T19:30:15","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/%year%\/%monthnum%\/%day%\/polls-on-covid-19-vaccination-closely-align-with-cdc-data\/"},"modified":"2025-04-23T23:56:36","modified_gmt":"2025-04-24T03:56:36","slug":"polls-on-covid-19-vaccination-closely-align-with-cdc-data","status":"publish","type":"short-read","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2021\/09\/20\/polls-on-covid-19-vaccination-closely-align-with-cdc-data\/","title":{"rendered":"Polls on COVID-19 vaccination closely align with CDC data"},"content":{"rendered":"\n<div class=\"wp-block-image\"><figure class=\"alignright size-420-wide\"><a rel=\"attachment wp-att-13625\" href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2021\/09\/20\/polls-on-covid-19-vaccination-closely-align-with-cdc-data\/ft_21-09-13_benchmarkingpollsvaccination-png\/\"><img data-dominant-color=\"f6f6f7\" data-has-transparency=\"false\" style=\"--dominant-color: #f6f6f7;\" loading=\"lazy\" decoding=\"async\"  srcset=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/FT_21.09.13_benchmarkingPollsVaccination.png?resize=480,666 480w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/FT_21.09.13_benchmarkingPollsVaccination.png?resize=782,1085 782w, https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/FT_21.09.13_benchmarkingPollsVaccination.png?resize=840,1165 840w\" sizes=\"(max-width: 480px) 480px, (max-width: 782px) 782px, 640px\" height=\"583\" width=\"420\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/FT_21.09.13_benchmarkingPollsVaccination.png?w=420\" alt=\"\" class=\"wp-image-13625 not-transparent\" \/><\/a><\/figure><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">The COVID-19 vaccination rate offers a rare opportunity for survey researchers to benchmark their data against a high-profile outcome other than an election \u2013 in this case, the share of adults who\u2019ve received at least one dose of a coronavirus vaccine as <a href=\"https:\/\/covid.cdc.gov\/covid-data-tracker\/#vaccinations_vacc-total-admin-rate-total\">documented by the Centers for Disease Control and Prevention (CDC)<\/a>. This kind of benchmarking helps to shed light on whether polls continue to provide reasonably accurate information about the U.S. public on this subject.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A Pew Research Center analysis finds that public polling on COVID-19 vaccination has tracked the CDC rate fairly closely. Polling estimates of the adult vaccination rate have been within about 2.8 percentage points, on average, of the rate calculated by the CDC. Around a quarter (22%) of the polls differed from the CDC estimate by less than 1 percentage point.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This analysis includes 98 public polls conducted by 19 different polling organizations from Dec. 29, 2020, to June 30, 2021. Researchers gauged the accuracy of each poll by computing the difference between the poll\u2019s published estimate and the vaccination rate from the CDC on the day the poll concluded.<\/p>\n\n\n<div style=\"border-width:1px;padding-bottom:var(--wp--preset--spacing--20);padding-left:var(--wp--preset--spacing--30);padding-right:var(--wp--preset--spacing--30);padding-top:var(--wp--preset--spacing--20);--block-gap: inherit\" class=\"is-style-alternate wp-block-prc-block-collapsible has-background has-ui-beige-very-light-background-color has-border-color has-ui-beige-dark-border-color\" id=\"how-we-did-this\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/collapsible&quot;}\" data-wp-context=\"{&quot;collapsibleId&quot;:&quot;how-we-did-this&quot;,&quot;isOpen&quot;:false}\" data-wp-class--is-open=\"context.isOpen\" data-wp-init--scroll-into-view=\"callbacks.onInitScrollIntoView\"><div class=\"wp-block-prc-block-collapsible__title\" data-wp-on--click=\"actions.onClick\"><div>How we did this<\/div><button class=\"wp-block-prc-block-collapsible__icon\"><span data-wp-bind--hidden=\"context.isOpen\"><i class=\"icon icon-library__light icon__circle-plus\"><svg style=\"width: 1em; height: 1em;\"><use xlink:href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/plugins\/prc-icon-library\/build\/icons\/sprites\/light.svg#circle-plus\"><\/use><\/svg><\/i><\/span><span data-wp-bind--hidden=\"!context.isOpen\" hidden><i class=\"icon icon-library__light icon__circle-minus\"><svg style=\"width: 1em; height: 1em;\"><use xlink:href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/plugins\/prc-icon-library\/build\/icons\/sprites\/light.svg#circle-minus\"><\/use><\/svg><\/i><\/span><\/button><\/div><div class=\"wp-block-prc-block-collapsible__content\">\n\n<p class=\"wp-block-paragraph\">Researchers collected 98 public polls conducted by 19 different pollsters from Dec. 29, 2020, to June 30, 2021. Researchers gauged the accuracy of each poll by computing the difference between the poll\u2019s published estimate and the vaccination rate from the Centers for Disease Control and Prevention (CDC) on the day the poll concluded. CDC numbers were collected from their <a href=\"https:\/\/data.cdc.gov\/Vaccinations\/COVID-19-Vaccinations-in-the-United-States-Jurisdi\/unsk-b7fc\">publicly available API<\/a>. For a complete list of polls that were included in this analysis, <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/2021\/09\/covid19_vax_poll_estimates.csv\">click here<\/a><em>.<\/em><\/p>\n\n<\/div><\/div>\n\n\n<p class=\"wp-block-paragraph\">When polls differed from the CDC rate, they often came in higher rather than lower \u2013 but not always. One notable difference between how polling fared for the 2020 presidential election and the COVID-19 vaccination rate is that polling errors regarding the vaccine have been less systematic (i.e., in the same direction). One way to measure systematic error, also known as bias, is by letting polls that&nbsp;<em>under<\/em>estimated the CDC benchmark cancel out polls that&nbsp;<em>over<\/em>estimated the benchmark. (Researchers call this computing the \u201csigned\u201d average error across polls.)&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In this analysis, once over- and underestimates of the CDC benchmark were allowed to cancel each other out, polls differed from the CDC rate by just +0.3 percentage points on average, with the net result being that the polls almost exactly matched the vaccination rate. For comparison, according to an&nbsp;<a href=\"https:\/\/www.aapor.org\/Education-Resources\/Reports\/2020-Pre-Election-Polling-An-Evaluation-of-the-202.aspx\">analysis<\/a>&nbsp;of national polls conducted in the final two weeks of the 2020 presidential election by the American Association for Public Opinion Research, polls \u201cunderstated Trump\u2019s share in the certified vote by 3.3 percentage points and overstated Biden\u2019s share in the certified vote by 1.0 percentage point.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To be sure, the vaccination rate among Americans was increasing while each poll was being conducted, making it difficult to pin down the exact difference in the vaccination rates reported in&nbsp; polling data and the official CDC rates. The median duration of the polls in this analysis was six days. If the polls\u2019 accuracy is judged based on the CDC rate for the mid-date of the data collection, rather than the final date, the average absolute difference would be 3.1 percentage points instead of 2.8. Further complicating the comparisons is the fact that the CDC rates themselves are not necessarily without error because of issues such as delays in jurisdictions reporting vaccinations.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/today.yougov.com\/topics\/politics\/articles-reports\/2021\/05\/04\/yougov-changing-how-we-ask-vaccination-question\">As other research has suggested,<\/a> poll results may differ from the CDC vaccination rate (and from each other) because of differences in how pollsters asked about vaccine status. The most common type of question in this analysis asks something like \u201cHave you gotten vaccinated for the coronavirus?\u201d with answer options for \u201cYes\u201d or \u201cNo.\u201d Other questions asked respondents if they knew anyone who had been vaccinated and included an answer option for the respondent to say they had received the vaccine themselves. Some pollsters asked if respondents planned to get vaccinated with an option to indicate that they had already received the vaccine. The average absolute difference for the 76 questions using a yes\/no format was 2.8 percentage points, compared with 3.0 points for all other questions (22 questions used a different format).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In some ways, the fact that the polling industry has done a better job estimating vaccinations than voting is not surprising. Election polls face challenges that don\u2019t exist for <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/methods\/2021\/03\/02\/what-2020s-election-poll-errors-tell-us-about-the-accuracy-of-issue-polling\/\">non-election polls<\/a> measuring public opinion on issues like abortion or immigration. Election polls focus on a future behavior (will you vote? for whom?) and need <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/methods\/2016\/01\/07\/measuring-the-likelihood-to-vote\/\">to screen for respondents who are likely voters<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Another kind of benchmarking involves pollsters <a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2018\/12\/06\/how-asking-about-your-sleep-smoking-or-yoga-habits-can-help-pollsters-verify-their-findings\/\">asking questions that are also on gold standard, high-response-rate government surveys<\/a> and comparing their results to the government result. While this is an important and worthwhile exercise, those analyses aren\u2019t comparing a survey to an objective outcome, but rather one survey to another.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Coronavirus vaccinations rates present pollsters with a rare opportunity to compare their results on a high-profile outcome that is both fully available to the U.S. adult population (rather than only citizens and registered voters) and has a known truth that pollsters can compare to. Unlike the polls\u2019 less-than-stellar performance in the 2020 election, the results from this analysis suggest that the polls have done well in tracking growth in the share of adults receiving the vaccines.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Public polling estimates on COVID-19 vaccination have been within about 2.8 points, on average, of the CDC&#8217;s calculated rate.<\/p>\n","protected":false},"author":459,"featured_media":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"sub_headline":"","sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","apple_news_api_created_at":"2021-09-20T20:16:56Z","apple_news_api_id":"efa5ee82-8f8e-472f-a603-35cc25442813","apple_news_api_modified_at":"2021-09-20T20:16:56Z","apple_news_api_revision":"AAAAAAAAAAD\/\/\/\/\/\/\/\/\/\/w==","apple_news_api_share_url":"https:\/\/apple.news\/A76Xugo-ORy-mAzXMJUQoEw","apple_news_cover_media_provider":"image","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_cover_video_id":0,"apple_news_cover_video_url":"","apple_news_cover_embedwebvideo_url":"","apple_news_is_hidden":"","apple_news_is_paid":"","apple_news_is_preview":"","apple_news_is_sponsored":"","apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":[],"apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"relatedPosts":[],"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"displayBylines":true,"footnotes":"","prc_watchers":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0},"categories":[448,433,357,269],"bylines":[779],"collection":[],"datasets":[],"_post_visibility":[],"formats":[467],"_fund_pool":[],"languages":[],"regions-countries":[515],"research-teams":[528],"workflow-status":[],"class_list":["post-8873","short-read","type-short-read","status-publish","hentry","category-coronavirus-disease-covid-19","category-covid-19-science","category-survey-methods","category-vaccines","bylines-nick-hatley","formats-short-read","regions-countries-united-states","research-teams-methods"],"label":"Short Read","post_parent":0,"word_count":870,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2021\/09\/20\/polls-on-covid-19-vaccination-closely-align-with-cdc-data\/","art_direction":{"A1":{"id":13634,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Homepage-A1-image-for-pewresearch.org_.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Homepage-A1-image-for-pewresearch.org_.png?w=564&h=317&crop=1","width":564,"height":317,"chartArt":false},"A2":{"id":13630,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Chart-art-image-for-pewresearch.org-.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Chart-art-image-for-pewresearch.org-.png?w=268&h=151&crop=1","width":268,"height":151,"chartArt":true},"A3":{"id":13630,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Chart-art-image-for-pewresearch.org-.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Chart-art-image-for-pewresearch.org-.png?w=194&h=110&crop=1","width":194,"height":110,"chartArt":true},"A4":{"id":13630,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Chart-art-image-for-pewresearch.org-.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Chart-art-image-for-pewresearch.org-.png?w=268&h=151&crop=1","width":268,"height":151,"chartArt":true},"XL":{"id":13634,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Homepage-A1-image-for-pewresearch.org_.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Homepage-A1-image-for-pewresearch.org_.png?w=720&h=405&crop=1","width":720,"height":405,"chartArt":false},"social":{"id":13633,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Social-media-image.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2021\/09\/Social-media-image.png?w=1200&h=628&crop=1","width":1200,"height":628,"chartArt":false}},"_embeds":[],"watchers":[],"table_of_contents":[],"datacite_doi":"","prc_seo_data":{"title":"Polls on COVID-19 vaccination closely align with CDC data","description":"Public polling estimates on COVID-19 vaccination have been within about 2.8 points, on average, of the CDC's calculated rate.","og_title":"Polls on COVID-19 vaccination closely align with CDC data","og_description":"Public polling estimates on COVID-19 vaccination have been within about 2.8 points, on average, of the CDC's calculated rate.","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":{"research-teams":10818965},"custom_schema":[],"twitter_title":"Polls on COVID-19 vaccination closely align with CDC data","twitter_description":"Public polling estimates on COVID-19 vaccination have been within about 2.8 points, on average, of the CDC's calculated rate.","og_image":13633,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{},"apple_news_notices":[],"jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[{"key":"_brz0b5zwv","termId":779}],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/8873","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/short-read"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/459"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=8873"}],"version-history":[{"count":1,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/8873\/revisions"}],"predecessor-version":[{"id":28431,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/8873\/revisions\/28431"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=8873"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=8873"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=8873"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=8873"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=8873"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=8873"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=8873"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=8873"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=8873"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=8873"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=8873"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=8873"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}