{"id":10994,"date":"2018-10-18T11:01:33","date_gmt":"2018-10-18T16:01:33","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/%year%\/%monthnum%\/%day%\/defining-the-universe-is-essential-when-writing-about-survey-data\/"},"modified":"2024-12-16T18:13:18","modified_gmt":"2024-12-16T23:13:18","slug":"defining-the-universe-is-essential-when-writing-about-survey-data","status":"publish","type":"short-read","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2018\/10\/18\/defining-the-universe-is-essential-when-writing-about-survey-data\/","title":{"rendered":"\u2018Defining the universe\u2019 is essential when writing about survey data"},"content":{"rendered":"\n
\"\"
(Alexander Spatari via Getty Images)<\/figcaption><\/figure>\n\n\n\n

The answer to almost any survey question depends on who you ask.<\/p>\n\n\n\n

\"Democrats<\/a>
(Alexander Spatari via Getty Images)<\/figcaption><\/figure>\n\n\n\n

At Pew Research Center, we conduct surveys in the United States and dozens of other countries on topics ranging from politics and religion to science and technology. Given the wide range of people we speak to for our polls \u2013 and the many issues we ask them about \u2013 it\u2019s important to be as clear as possible in our writing about exactly who<\/em> says what<\/em>.<\/p>\n\n\n\n

In research circles, this practice is sometimes called \u201cdefining the universe\u201d \u2013 that is, clearly identifying the population whose attitudes we\u2019re studying, whether those people are police officers in the U.S.<\/a>, Christians in Western Europe<\/a> or some other specific group. This kind of clarification can go a long way toward ensuring that readers interpret survey results correctly.<\/p>\n\n\n\n

<\/p>\n\n\n\n

In many cases, the universe of survey respondents we\u2019re talking about is relatively straightforward. If we say that nearly two-thirds of U.S. adults<\/a> think the national economic situation is good, we\u2019re referring to the views of Americans ages 18 and older. But in other cases, additional clarification and context may be needed, particularly for readers who aren\u2019t schooled in the art of interpreting poll results.<\/p>\n\n\n\n

\"Survey<\/figure>\n\n\n\n

Consider one of our recent survey findings<\/a> about Facebook users. The survey found that 74% of adult Facebook users in the U.S. have taken at least one of the following three steps in the past 12 months: adjusted their privacy settings, taken a break from checking the platform for several weeks or more, or deleted the app from their phone. The survey drew a lot of attention<\/a> because it suggested \u2013 correctly \u2013 that adult Facebook users in the U.S. have a complex relationship with one of the major social platforms in their lives.<\/p>\n\n\n\n

But there are some caveats to bear in mind when considering this finding. First, not all U.S. adults use Facebook. Pew Research Center\u2019s most recent estimate<\/a> is that 68% of American adults use the platform. In other words, it\u2019s not<\/em> accurate to say that 74% of all U.S. adults<\/em> have adjusted their Facebook privacy settings, taken a break from the platform or deleted the app from their phone in the past 12 months. It is<\/em> accurate to say that 74% of U.S. adults who currently use Facebook<\/em> \u2013 that is, 74% of that 68% \u2013 have taken one of these three steps in the past year.<\/p>\n\n\n\n

It\u2019s also crucial to remember that this finding only refers to adult Facebook users in one country. Worldwide, Facebook claims more than 2 billion monthly active users<\/a>, and our survey did not include respondents from countries outside the U.S. It also doesn\u2019t reflect U.S. Facebook users who are younger than 18 \u2013 a substantial population. How substantial? We know from a separate Pew Research Center survey<\/a> earlier this year that 51% of U.S. teens ages 13 to 17 use Facebook. And there may be many other U.S. Facebook users who are younger than 13.<\/p>\n\n\n\n

Another example of a survey universe that\u2019s not always easily understood concerns U.S. politics. Pew Research Center and other polling organizations frequently conduct polls to find out Americans\u2019 views on political topics. But these views can vary<\/a> depending on whether the universe of interest is all U.S. adults, registered voters, or \u2013 in some cases \u2013 an even more narrowly defined group, likely voters.<\/p>\n\n\n\n

Only about two-thirds of adults are registered to vote, and these adults tend to be more politically engaged than those who are not registered. That can translate into differences in attitudes.<\/p>\n\n\n\n

Some polling organizations also report on the subset of the public they deem likely<\/em> to vote, particularly for surveys conducted in the run-up to an election. This determination is complicated, but might be made by asking respondents questions about their voting behavior and intentions, or by using people\u2019s past records of voting, among other things.<\/p>\n\n\n\n

Since different polling organizations use different definitions of the term \u201clikely voters,\u201d it\u2019s important to understand who is and isn\u2019t included in the definition being used. Only a third of U.S. adults<\/a> cast ballots in the last midterm election, so a report based on likely midterm voters is aimed at understanding the views of that subset of the adult population.<\/p>\n\n\n\n

Survey data can be tricky for non-experts to follow, as we\u2019ve noted in prior blog posts. It can be confusing for some readers to understand why 51% may not represent a \u201cmajority,\u201d<\/a> or how a survey of 1,000 people can tell you what an entire country thinks<\/a>. One way to help readers interpret the many poll findings they encounter is to be as clear as possible about the group of people whose answers are being described.<\/p>\n","protected":false},"excerpt":{"rendered":"

Given the wide range of people we speak to for our polls \u2013 and the issues we ask them about \u2013 it\u2019s important to be as clear as possible about exactly who says what. In research circles, this practice is sometimes called \u201cdefining the universe.”<\/p>\n","protected":false},"author":386,"featured_media":21184,"comment_status":"closed","ping_status":"closed","template":"","meta":{"sub_headline":"","sub_title":"","_crdt_document":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","apple_news_api_created_at":"","apple_news_api_id":"","apple_news_api_modified_at":"","apple_news_api_revision":"","apple_news_api_share_url":"","apple_news_cover_media_provider":"image","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_cover_video_id":0,"apple_news_cover_video_url":"","apple_news_cover_embedwebvideo_url":"","apple_news_is_hidden":"","apple_news_is_paid":"","apple_news_is_preview":"","apple_news_is_sponsored":"","apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":[],"apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"relatedPosts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"bylines":[{"key":"fbbca84a-3c41-4aa4-b05f-237797051891","termId":879}],"acknowledgements":[],"displayBylines":true,"footnotes":"","prc_watchers":[]},"categories":[36,401,357],"bylines":[879],"collection":[],"datasets":[],"_post_visibility":[],"formats":[467],"_fund_pool":[],"languages":[],"regions-countries":[515],"research-teams":[521,525,529,526,527,528,522,520,523,517,518,519],"workflow-status":[],"class_list":["post-10994","short-read","type-short-read","status-publish","has-post-thumbnail","hentry","category-methodological-research","category-survey-basics","category-survey-methods","bylines-john-gramlich","formats-short-read","regions-countries-united-states","research-teams-data-labs","research-teams-global","research-teams-global-migration-and-demography","research-teams-internet","research-teams-journalism","research-teams-methods","research-teams-pew-research-center","research-teams-politics","research-teams-race-and-ethnicity","research-teams-religion","research-teams-science","research-teams-social-trends"],"label":"Short Read","post_parent":0,"word_count":790,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/short-reads\/2018\/10\/18\/defining-the-universe-is-essential-when-writing-about-survey-data\/","art_direction":{"A1":{"id":21184,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp?w=564&h=317&crop=1","width":564,"height":317,"chartArt":false},"A2":{"id":21184,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp?w=268&h=151&crop=1","width":268,"height":151,"chartArt":false},"A3":{"id":21184,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp?w=194&h=110&crop=1","width":194,"height":110,"chartArt":false},"A4":{"id":21184,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp?w=268&h=151&crop=1","width":268,"height":151,"chartArt":false},"XL":{"id":21184,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp?w=640&h=360&crop=1","width":640,"height":360,"chartArt":false},"social":{"id":21184,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2018\/10\/FT_18.10.12_DefiningUniverse_feature-jpg.webp?w=640&h=360&crop=1","width":640,"height":360,"chartArt":false}},"_embeds":[],"watchers":[],"table_of_contents":[],"datacite_doi":"","prc_seo_data":{"title":"\u2018Defining the universe\u2019: An essential in writing about survey data","description":"Given the wide range of people we speak to for our polls \u2013 and the many issues we ask about \u2013 it\u2019s important to be as clear as possible about who says what.","og_title":"\u2018Defining the universe\u2019 is essential when writing about survey data","og_description":"Given the wide range of people we speak to for our polls \u2013 and the many issues we ask about \u2013 it\u2019s important to be as clear as possible about who says what.","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"twitter_title":"\u2018Defining the universe\u2019 is essential when writing about survey data","twitter_description":"Given the wide range of people we speak to for our polls \u2013 and the many issues we ask about \u2013 it\u2019s important to be as clear as possible about who says what.","og_image":21184,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{},"apple_news_notices":[],"jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[{"key":"fbbca84a-3c41-4aa4-b05f-237797051891","termId":879}],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/10994","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/short-read"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/386"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=10994"}],"version-history":[{"count":4,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/10994\/revisions"}],"predecessor-version":[{"id":196345,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/short-read\/10994\/revisions\/196345"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media\/21184"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=10994"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=10994"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=10994"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=10994"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=10994"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=10994"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=10994"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=10994"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=10994"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=10994"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=10994"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=10994"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}