{"id":12207,"date":"2017-02-16T14:29:55","date_gmt":"2017-02-16T19:29:55","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/%year%\/%monthnum%\/%day%\/does-poll-include-or-exclude-nonvoters\/"},"modified":"2024-04-14T03:16:59","modified_gmt":"2024-04-14T08:16:59","slug":"does-poll-include-or-exclude-nonvoters","status":"publish","type":"short-read","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2017\/02\/16\/does-poll-include-or-exclude-nonvoters\/","title":{"rendered":"A basic question when reading a poll: Does it include or exclude nonvoters?"},"content":{"rendered":"

The early days of a new presidential administration produce not just a blizzard of news but a blizzard of numbers. Pollsters of all stripes race to get and report Americans\u2019 first impressions of their new president. But, frustratingly, those reports don\u2019t always match up as precisely as the Type A among us might wish.<\/p>\n\n

Take the past three weeks of polling on President Donald Trump. Depending on the poll, Trump\u2019s approval rating between Feb. 5 and 13 could have been as high as 53% or as low as 39%. So which was it?<\/p>\n\n

There are a number of possible reasons for polls arriving at different estimates \u2013 from the mode used to collect data<\/a> to how people are selected for a survey\u00a0\u2013 but here we\u2019ll tackle one of the most basic: Did the poll include or exclude the 45% of adult Americans who didn\u2019t cast a vote last November?<\/p>\n\n

<\/figure>\n\n

Typically, polls in the U.S. are designed to represent one of three populations. The broadest is the general population of all adults (GP). Surveys based only on adults who are registered to vote (RV) apply a narrower lens on the public. Narrower still is the filter applied with surveys that interview only registered voters who are deemed likely<\/em> to vote (LV). Many pollsters might conduct surveys of all three, depending on where they find themselves in the election cycle.<\/p>\n\n

In non-election years like this one, most pollsters survey all adults, but not all follow this convention. A number of pollsters continue to do surveys of registered or even likely voters. Why does this matter for Trump\u2019s approval ratings? It\u2019s about demographics. Voters as a group skew older and whiter <\/a>than the general public. And older Americans, as well as white Americans, tilt more Republican than other groups. So, voter-only polls tend to get somewhat more favorable views of a Republican president or candidate and less favorable views of Democrats. This pattern was evident during Barack Obama\u2019s presidency, with his overall ratings tending to be somewhat higher among the general public than among registered or likely voters.\u00a0<\/p>\n\n

A look at some of the presidential approval numbers released this month shows a pattern consistent with these demographic differences. LV polls \u2013 those surveys based only on the views of \u201clikely voters\u201d \u2013 are generally reporting higher levels of support for Trump than general population polls. There is a more muted but still significant difference in an RV-GP comparison: Pew Research Center\u2019s general population poll <\/a>conducted Feb. 7-12<\/a>\u00a0recorded Trump\u2019s presidential approval rating at 39%. Among registered voters in that survey, his rating was 42%.<\/p>\n\n

Registered voter polls exclude nearly 40% of the population<\/h4>\n\n

So how many people are we including, or excluding, when we decide to look at the views of only registered or likely voters? In the U.S., roughly six-in-ten adults are registered to vote. The registration rate tends to tick up a few points in presidential election years (to about 65%<\/a>) and back down a few points<\/a> in non-election years. This means that RV polls, by design, exclude nearly 40% of adults living in the U.S.<\/p>\n\n

LV polls, of course, exclude even more, as they aim to include only those registered voters who actually cast, or will cast, a ballot. The voting rate among adults ages 18 and older was 55%<\/a> in the 2016 presidential election and 33%<\/a> in the most recent midterm election. If a pollster is currently conducting an LV poll with 2018 (a midterm election year) in mind, then recent midterm voting behavior suggests that their results might be excluding the views of a majority of adults in the U.S.<\/p>\n\n

So what is the appropriate population to represent?<\/h4>\n\n

Which population is appropriate \u2013 all adults, registered voters or likely voters \u2013 depends on what information the poll is intended to gather. For political operatives whose jobs (winning elections) require them to be in perpetual campaign mode, polls of registered or likely voters arguably provide the most accurate information about the mood and opinions of that subset of Americans who will actually cast a ballot in the next election. The fact that the poll excludes a large share of the population is a desired feature, not a bug.<\/p>\n\n

For those interested in the opinions and experiences of the entire country, as is the case here at the Center, general population polls are a more informative and useful tool. Nonvoters, like any other group of Americans, include people who pay taxes, want health insurance, run small businesses, use the public education or court systems and have a stake in the nation\u2019s security \u2013 even though they do not play a role in selecting the officials who craft the public policies that affect them.<\/p>\n\n

A last thought on nonvoters<\/h4>\n\n

While nonvoters do lean more Democratic than Republican, it would be a mistake to cast them as a partisan lot. Overall, they are much less likely than registered adults to identify with either major party (24% don\u2019t lean toward either party, compared with 6% among voters). So polls that exclude nonvoters don\u2019t just change the shade of the country\u2019s partisan balance, they paint a portrait of a public that is distinctly more politically engaged and ideological than those that survey all adults.<\/p>\n\n

Correction: A previous version of this post and accompanying chart gave an incorrect figure for the Feb. 7 Rasmussen poll.<\/em><\/p>","protected":false},"excerpt":{"rendered":"

Opinion polls in the U.S. can address the same topic yet reach very different results. There are several reasons this can happen, but we tackle one of the most basic: Did the poll include or exclude the 45% who didn\u2019t vote in November?<\/p>\n","protected":false},"author":370,"featured_media":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"sub_headline":"","sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","apple_news_api_created_at":"","apple_news_api_id":"","apple_news_api_modified_at":"","apple_news_api_revision":"","apple_news_api_share_url":"","apple_news_cover_media_provider":"image","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_cover_video_id":0,"apple_news_cover_video_url":"","apple_news_cover_embedwebvideo_url":"","apple_news_is_hidden":"","apple_news_is_paid":"","apple_news_is_preview":"","apple_news_is_sponsored":"","apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":[],"apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"relatedPosts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"displayBylines":true,"footnotes":"","prc_watchers":[]},"categories":[68,36,359,25,401,357,358],"bylines":[944,631],"collection":[],"datasets":[],"_post_visibility":[],"formats":[467],"_fund_pool":[],"languages":[],"regions-countries":[515],"research-teams":[528,520],"workflow-status":[],"class_list":["post-12207","short-read","type-short-read","status-publish","hentry","category-donald-trump","category-methodological-research","category-nonprobability-surveys","category-politics-policy","category-survey-basics","category-survey-methods","category-telephone-surveys","bylines-claudia-deane","bylines-courtney-kennedy","formats-short-read","regions-countries-united-states","research-teams-methods","research-teams-politics"],"label":"Short Read","post_parent":0,"word_count":883,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2017\/02\/16\/does-poll-include-or-exclude-nonvoters\/","art_direction":{"A1":{"id":23079,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png?w=310&h=317&crop=1","width":310,"height":317,"chartArt":false},"A2":{"id":23079,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png?w=268&h=151&crop=1","width":268,"height":151,"chartArt":false},"A3":{"id":23079,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png?w=194&h=110&crop=1","width":194,"height":110,"chartArt":false},"A4":{"id":23079,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png?w=268&h=151&crop=1","width":268,"height":151,"chartArt":false},"XL":{"id":23079,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png?w=310&h=405&crop=1","width":310,"height":405,"chartArt":false},"social":{"id":23079,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2017\/02\/FT_17.02.16_TrumpApprovalMethodology.png?w=310&h=526&crop=1","width":310,"height":526,"chartArt":false}},"_embeds":[],"watchers":[],"table_of_contents":[],"datacite_doi":"","prc_seo_data":{"title":"Why it matters whether an opinion poll includes nonvoters","description":"Polls on a topic can reach very different results for several reasons. We tackle one: Did the poll include or exclude the 45% who didn\u2019t vote in November?","og_title":"A basic question when reading a poll: Does it include or exclude nonvoters?","og_description":"Opinion polls in the U.S. can address the same topic yet reach very different results. There are several reasons this can happen, but we tackle one of the most basic: Did the poll include or exclude the 45% who didn\u2019t vote in November?","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"og_image":23079,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{},"apple_news_notices":[],"jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[{"key":"e1d28ebce0369581d3b3fd79d74d1b1d","termId":631},{"key":"2faadcf60d773bd5d0cbdb977ea56c02","termId":944}],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/12207","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/short-read"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/370"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=12207"}],"version-history":[{"count":2,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/12207\/revisions"}],"predecessor-version":[{"id":102582,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/12207\/revisions\/102582"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=12207"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=12207"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=12207"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=12207"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=12207"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=12207"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=12207"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=12207"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=12207"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=12207"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=12207"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=12207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}