{"id":111707,"date":"2018-06-27T10:04:00","date_gmt":"2018-06-27T15:04:00","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/decoded\/\/\/how-to-analyze-pew-research-center-survey-data-in-r\/"},"modified":"2024-04-17T05:13:42","modified_gmt":"2024-04-17T09:13:42","slug":"how-to-analyze-pew-research-center-survey-data-in-r","status":"publish","type":"decoded","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/decoded\/2018\/06\/27\/how-to-analyze-pew-research-center-survey-data-in-r\/","title":{"rendered":"How to analyze Pew Research Center survey data in R"},"content":{"rendered":"\n
\"\"<\/a>
(Related post: <\/em>Using tidyverse tools with Pew Research Center survey data in R<\/em><\/a>)<\/em><\/figcaption><\/figure>\n\n\n\n

Pew Research Center releases its survey data publicly as IBM SPSS files with the .sav extension. But if you don\u2019t have access to SPSS, there are free, open-source tools available to analyze and make use of the data.<\/p>\n\n\n\n

Even with basic SPSS access, working with survey data requires additional tools or techniques to correctly handle survey weights or other complex survey design features. Analyses that fail to take these design features into account can produce biased results and overstate the precision of estimates or statistical tests. Fortunately, the tools to perform these kinds of analyses correctly are freely available with the R statistical software platform.<\/p>\n\n\n\n

This post provides a quick tutorial on how to correctly analyze the Center\u2019s survey data using R. This is the first in an occasional series of posts aimed at helping you analyze survey datasets using R.<\/p>\n\n\n\n

What is R?<\/strong><\/h4>\n\n\n\n

R is a language and environment for statistical computing and graphics. R is available as free software in source code form under the terms of the Free Software Foundation\u2019s GNU General Public License. It compiles and runs on a wide variety of UNIX platforms and similar systems (including FreeBSD and Linux), Windows and MacOS. To read more about R and how to download it, visit r-project.org<\/a>.<\/p>\n\n\n\n

The analysis in this post will rely on: 
\u2014 R
\u2014 R Studio<\/a> (an open-source code editor and interface working in the R language)
\u2014 The following freely available R packages<\/a>:
\u00b7 foreign<\/a>
<\/mark>\u00b7 survey<\/a>
<\/mark>\u00b7 knitr<\/a><\/p>\n\n\n\n

To install these packages, use the following code:<\/p>\n\n\n\n

install.packages(c(\"foreign\", \"survey\", \"knitr\"))<\/code><\/pre>\n\n\n\n
Accessing Pew Research Center data<\/strong><\/h4>\n\n\n\n
Many Pew Research Center survey datasets are available for download by accessing the \u201cDatasets\u201d tab<\/a> on the Center\u2019s website. For more information about the kind of data the Center releases and how to access it, read this blog post<\/a>.<\/p>\n\n\n\n
Almost all of the data that\u2019s available to download from the Center is stored as SPSS .sav files. SPSS files often contain both values and value labels \u2014 for example, 1 for Republican, 2 for Democrat.<\/p>\n\n\n\n
This tutorial will use data from the Center\u2019s April 2017 political survey, which focused on topics including Americans\u2019 views of national institutions<\/a> and their trust in government<\/a>.<\/p>\n\n\n\n
Loading the survey data into R<\/strong><\/h4>\n\n\n\n
The first step to analyzing survey data in R is to read the data file into your R environment. Since the data is stored as a .sav file, you\u2019ll want to use the read.spss()<\/strong> function from R\u2019s \u201cforeign\u201d package. Below, we first load the package libraries and then read the data into a data.frame which we\u2019ll call \u201cApr17\u201d. By default, read.spss() retains all of the variable and value labels for the survey data, but it doesn\u2019t automatically create a data.frame, so we have to set a parameter explicitly. Here we use to.data.frame = TRUE<\/strong> to load the file into our R environment as a data.frame.<\/p>\n\n\n\n
library(foreign)\n library(survey)\n library(knitr)\n Apr17 <- read.spss(\"Apr17 public.sav\", #file path to dataset \n                    to.data.frame = TRUE) #sets object to data frame## re-encoding from CP1252<\/code><\/pre>\n\n\n\n
If you run this code, you will get a warning for variables that do not have labels for every category \u2014 such as age. In these instances read.spss()<\/strong>will add these labels by default. If you are looking for a different behavior, check out theadd.undeclared.levels()<\/strong> option.<\/p>\n\n\n\n
Most of the variables in the Center\u2019s datasets \u2014 such as sex, race and so on \u2014 are categorical. In R, these kinds of variables are called factors. You can use the table()<\/strong> function to see how a factor variable is distributed as follows:<\/p>\n\n\n\n
table(Apr17$party) ## \n ##                Republican                  Democrat \n ##                       375                       466 \n ##               Independent      No preference (VOL.) \n ##                       616                        28 \n ##        Other party (VOL.) Don't know\/Refused (VOL.) \n ##                         9                         7<\/code><\/pre>\n\n\n\n
Setting up a survey design<\/strong><\/h4>\n\n\n\n
The next step in analyzing the survey data is to use the svydesign<\/strong> function from R\u2019s \u201csurvey\u201d package to create a survey design object. This step is important in that it explicitly states the survey design to properly use survey weights and other design components for estimation. The svydesign<\/strong> function accepts many different forms of complex survey designs. To read more detail about the function, click here<\/a>.<\/p>\n\n\n\n
For the majority of Pew Research Center surveys, including the April 2017 dataset used in this tutorial, users need to specify three items when declaring the survey design:

1. The cluster identifiers with ids = <\/strong>. Almost all of the U.S.-based surveys from the Center do not have cluster identifiers. Use the ~0 formula to indicate this survey doesn\u2019t have any clusters.
2. The survey dataset with data =
<\/strong>3. The survey weights with weights =<\/strong><\/p>\n\n\n\n
Apr17_design = svydesign(\nids = ~0, #formula indicating there are no clusters\ndata = Apr17, #this is the dataset\nweights = ~weight) #this is the 'weight' variable\n#from the Apr17 dataset<\/code><\/pre>\n\n\n\n
Estimating frequencies with survey weights<\/strong><\/h4>\n\n\n\n
After the survey design is declared, you can obtain weighted estimates by using the svymean()<\/strong> function. The core arguments of svymean()<\/strong> are the formula identifying the variable you are interested in and the survey design object.<\/p>\n\n\n\n
The svymean()<\/strong> function can be used to compute weighted means, variances, ratios, totals and more. The returned statistic is dependent on the class of the variable it is called upon. For example, to estimate President Donald Trump\u2019s job approval (q1- a factor variable), use the following code:<\/p>\n\n\n\n
svymean(~q1,                    #variable to estimate\n         design =  Apr17_design #survey design object\n                                #created with svydesign()\n         ) ##                                 mean     SE\n ## q1Approve                   0.394008 0.0144\n ## q1Disapprove                0.542368 0.0147\n ## q1Don't know\/Refused (VOL.) 0.063624 0.0078<\/code><\/pre>\n\n\n\n
To look at Trump\u2019s job approval among different subgroups, you can use the svyby()<\/strong> function, which computes statistics for subgroups of the dataset. The svymean()<\/strong> function can be used in conjunction with the svyby()<\/strong> function to compute weighted estimates on subsets of the data determined by other factor variables. The kable()<\/strong> function from the knitr package displays the statistics in tabular form.<\/p>\n\n\n\n
To estimate presidential approval among men and women, for instance, you can use this code:<\/p>\n\n\n\n
q1_by_sex = svyby(~q1, #variable to estimate\n~sex, #subgroup variable\ndesign = Apr17_design,\nFUN = svymean, #function to use on each subgroup\nkeep.names = FALSE #does not include row.names\n#for subgroup variable\n)\n\nknitr::kable(q1_by_sex, digits = 2)<\/code><\/pre>\n\n\n\n
\"\"<\/a><\/figure>\n\n\n\n
This post just scratches the surface of the kinds of analyses you can do in R with the survey package, but I hope it\u2019s enough to get you started. In the future, we plan to write additional posts on survey data analysis and visualization with R. If you have questions about this post, or if there are other things with survey data and R you\u2019d like to know how to do, let us know at info@pewresearch.org<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"
Pew Research Center releases its survey data publicly as IBM SPSS files with the .sav extension. But if you don\u2019t have access to SPSS, there are free, open-source tools available to analyze and make use of the data.<\/p>\n","protected":false},"author":655,"featured_media":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"sub_headline":"","sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","relatedPosts":[],"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"displayBylines":true,"footnotes":"","prc_watchers":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0},"categories":[357],"bylines":[779],"collection":[],"_post_visibility":[],"decoded-category":[531,532],"formats":[],"_fund_pool":[],"languages":[],"regions-countries":[],"research-teams":[524],"workflow-status":[],"class_list":["post-111707","decoded","type-decoded","status-publish","hentry","category-survey-methods","bylines-nick-hatley","decoded-category-coding-how-to","decoded-category-survey-methods","research-teams-decoded"],"label":"Decoded","post_parent":0,"word_count":1165,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/decoded\/2018\/06\/27\/how-to-analyze-pew-research-center-survey-data-in-r\/","art_direction":{"A1":{"id":139491,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png?w=564&h=317&crop=1","width":564,"height":317,"caption":"","chartArt":false},"A2":{"id":139491,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png?w=268&h=151&crop=1","width":268,"height":151,"caption":"","chartArt":false},"A3":{"id":139491,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png?w=194&h=110&crop=1","width":194,"height":110,"caption":"","chartArt":false},"A4":{"id":139491,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png?w=268&h=151&crop=1","width":268,"height":151,"caption":"","chartArt":false},"XL":{"id":139491,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png?w=720&h=405&crop=1","width":720,"height":405,"caption":"","chartArt":false},"social":{"id":139491,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/08\/06.27.2018_featured.png?w=1200&h=628&crop=1","width":1200,"height":628,"caption":"","chartArt":false}},"_embeds":[],"watchers":[],"table_of_contents":[],"datacite_doi":"","prc_seo_data":{"title":"How to analyze Pew Research Center survey data in R","description":"Pew Research Center releases its survey data publicly as IBM SPSS files with the .sav extension. But if you don\u2019t have access to SPSS, there are free, open-source tools available to analyze and make use of the data.","og_title":"How to analyze Pew Research Center survey data in R","og_description":"Pew Research Center releases its survey data publicly as IBM SPSS files with the .sav extension. But if you don\u2019t have access to SPSS, there are free, open-source tools available to analyze and make use of the data.","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":{"category":43},"custom_schema":[],"og_image":139491,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{},"jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[{"key":"_m6sdig9ro","termId":779}],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/decoded\/111707","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/decoded"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/decoded"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/655"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=111707"}],"version-history":[{"count":3,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/decoded\/111707\/revisions"}],"predecessor-version":[{"id":139519,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/decoded\/111707\/revisions\/139519"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=111707"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=111707"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=111707"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=111707"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=111707"},{"taxonomy":"decoded-category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/decoded-category?post=111707"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=111707"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=111707"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=111707"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=111707"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=111707"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=111707"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}