{"id":96659,"date":"2005-10-05T00:00:00","date_gmt":"2005-10-05T05:00:00","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/2005\/10\/05\/methodology-121-2\/"},"modified":"2024-04-14T04:14:19","modified_gmt":"2024-04-14T09:14:19","slug":"methodology-121-2","status":"publish","type":"post","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/methodology-121-2\/","title":{"rendered":"Methodology"},"content":{"rendered":"<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;summary&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" id=\"summary\" class=\"wp-block-heading\">Summary<\/h3>\n\n<p class=\"wp-block-paragraph\">This survey, sponsored by the Pew Internet &amp; American Life Project, obtained telephone interviews with a nationally representative sample of 2,001 adults living in continental United States telephone households. The survey was conducted by Princeton Survey Research International. Interviews were done in English by Princeton Data Source, LLC from May 4 to June 7, 2005. Statistical results are weighted to correct known demographic discrepancies. The margin of sampling error for the complete set of weighted data is \u00b12.3%.<\/p>\n\n<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;design-and-data-collection-procedures&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" id=\"design-and-data-collection-procedures\" class=\"wp-block-heading\">Design and Data Collection Procedures<\/h3>\n\n\n\n<h2 id=\"sample-design\" class=\"wp-block-heading\">Sample Design<\/h2>\n\n<p class=\"wp-block-paragraph\">The sample was designed to represent all continental U.S. telephone households. The telephone sample was provided by Survey Sampling International, LLC (SSI) according to PSRAI specifications. The sample was drawn using standard list-assisted random digit dialing (RDD) methodology. Active blocks of telephone numbers (area code + exchange + two-digit block number) that contained three or more residential directory listings were selected with probabilities in proportion to their share of listed telephone households; after selection two more digits were added randomly to complete the number. This method guarantees coverage of every assigned phone number regardless of whether that number is directory listed, purposely unlisted, or too new to be listed. After selection, the numbers were compared against business directories and matching numbers purged.<\/p>\n\n\n\n<h2 id=\"contact-procedures\" class=\"wp-block-heading\">Contact Procedures<\/h2>\n\n<p class=\"wp-block-paragraph\">Interviews were conducted from May 4 to June 7, 2005. As many as 10 attempts were made to contact every sampled telephone number. Sample was released for interviewing in replicates, which are representative subsamples of the larger sample. Using replicates to control the release of sample ensures that complete call procedures are followed for the entire sample. <\/p>\n\n<p class=\"wp-block-paragraph\">Calls were staggered over times of day and days of the week to maximize the chance of making contact with potential respondents. Each household received at least one daytime call in an attempt to find someone at home. In each contacted household, interviewers asked to speak with the youngest adult male currently at home. If no male was available, interviewers asked to speak with either the youngest or oldest female at home based on a random rotation.[11.numoffset=&#8221;11&#8243; This is part of a continuing experiment to see what effect, if any, asking for the youngest instead of the oldest female has on sample demographics.] This systematic respondent selection technique has been shown to produce samples that closely mirror the population in terms of age and gender.<\/p>\n\n<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;weighting-and-analysis&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" id=\"weighting-and-analysis\" class=\"wp-block-heading\">Weighting and Analysis<\/h3>\n\n<p class=\"wp-block-paragraph\">Weighting is generally used in survey analysis to compensate for patterns of nonresponse that might bias results. The interviewed sample of all adults was weighted to match national parameters for sex, age, education, race, Hispanic origin and region (U.S. Census definitions). These parameters came from a special analysis of the Census Bureau\u2019s 2004 Annual Social and Economic Supplement (ASEC) that included all households in the continental United States that had a telephone. <\/p>\n\n<p class=\"wp-block-paragraph\">Weighting was accomplished using Sample Balancing, a special iterative sample weighting program that simultaneously balances the distributions of all variables using a statistical technique called the Deming Algorithm. Weights were trimmed to prevent individual interviews from having too much influence on the final results. The use of these weights in statistical analysis ensures that the demographic characteristics of the sample closely approximate the demographic characteristics of the national population. Table 1 compares weighted and unweighted sample distributions to population parameters.<\/p>\n\n<p class=\"wp-block-paragraph\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"502\" height=\"617\" alt=\"Table 1: Sample Demographics\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/media\/390908EA52E44D79B4A0EA223F8E8508.jpg\" class=\"aligncenter\"><\/figure>\n<\/p>\n\n<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;effects-of-sample-design-on-statistical-inference&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" id=\"effects-of-sample-design-on-statistical-inference\" class=\"wp-block-heading\">Effects of Sample Design on Statistical Inference<\/h3>\n\n<p class=\"wp-block-paragraph\">Post-data collection statistical adjustments require analysis procedures that reflect departures from simple random sampling. PSRAI calculates the effects of these design features so that an appropriate adjustment can be incorporated into tests of statistical significance when using these data. The so-called &#8220;design effect&#8221; or <i>deff<\/i> represents the loss in statistical efficiency that results from systematic non-response. The total sample design effect for this survey is 1.12.<\/p>\n\n<p class=\"wp-block-paragraph\">PSRAI calculates the composite design effect for a sample of size <i>n<\/i>, with each case having a weight, <i>w<sub>i<\/sub><\/i> as:<\/p>\n\n<p class=\"wp-block-paragraph\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"133\" height=\"93\" alt=\"Formula 1\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/media\/85CBD99F4B9146AB8415964CC0ECE125.jpg\" class=\"aligncenter\"><\/figure>\n<\/p>\n\n<p class=\"wp-block-paragraph\">In a wide range of situations, the adjusted <i>standard error<\/i> of a statistic should be calculated by multiplying the usual formula by the square root of the design effect (\u221a<i>deff)<\/i>. Thus, the formula for computing the 95% confidence interval around a percentage is:<\/p>\n\n<p class=\"wp-block-paragraph\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"198\" height=\"55\" alt=\"Formula 2\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/media\/3B468D6AC57F40B0AD5DA2D6D10F442C.jpg\" class=\"aligncenter\"><\/figure>\n<\/p>\n\n<p class=\"wp-block-paragraph\">where <em>p<\/em>\u02c6\u00a0is the sample estimate and <i>n<\/i> is the unweighted number of sample cases in the group being considered.<\/p>\n\n<p class=\"wp-block-paragraph\">The survey\u2019s <i>margin of error<\/i> is the largest 95% confidence interval for any estimated proportion based on the total sample\u2014 the one around 50%. For example, the margin of error for the entire sample is \u00b13.3%. This means that in 95 out every 100 samples drawn using the same methodology, estimated proportions based on the entire sample will be no more than 3.3 percentage points away from their true values in the population. It is important to remember that sampling fluctuations are only one possible source of error in a survey estimate. Other sources, such as respondent selection bias, questionnaire wording and reporting inaccuracy, may contribute additional error of greater or lesser magnitude.<\/p>\n\n<h3 data-is-section=\"true\" data-wp-context=\"{&quot;id&quot;:&quot;response-rate&quot;}\" data-wp-interactive=\"{&quot;namespace&quot;:&quot;prc-block\\\/table-of-contents&quot;}\" id=\"response-rate\" class=\"wp-block-heading\">Response Rate<\/h3>\n\n<p class=\"wp-block-paragraph\">Table 2 reports the disposition of all sampled telephone numbers ever dialed from the original telephone number sample. The response rate estimates the fraction of all eligible respondents in the sample that were ultimately interviewed. At PSRAI it is calculated by taking the product of three component rates:[12.numoffset=&#8221;12&#8243; PSRAI\u2019s disposition codes and reporting are consistent with the American Association for Public Opinion Research standards.]<\/p>\n\n<ul class=\"wp-block-list\">\n<li>Contact rate \u2013 the proportion of working numbers where a request for interview was made \u2013 of 80 percent[13. PSRAI assumes that 75 percent of cases that result in a constant disposition of \u201cNo answer\u201d or \u201cBusy\u201d over 10 or more attempts are actually not working numbers.]<\/li>\n<li>Cooperation rate \u2013 the proportion of contacted numbers where a consent for interview was at least initially obtained, versus those refused \u2013 of 48 percent<\/li>\n<li>Completion rate \u2013 the proportion of initially cooperating and eligible interviews that were completed \u2013 of 91 percent<\/li>\n<\/ul>\n\n<p class=\"wp-block-paragraph\">Thus the response rate for this survey was 35 percent.<\/p>\n\n<p class=\"wp-block-paragraph\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"289\" height=\"600\" alt=\"Table 2: Sample Disposition\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/media\/464CAE00738840ABAA4E37E0ACCD88B4.jpg\" class=\"aligncenter\"><\/figure><\/p>","protected":false},"excerpt":{"rendered":"<p>Summary This survey, sponsored by the Pew Internet &amp; American Life Project, obtained telephone interviews with a nationally representative sample of 2,001 adults living in continental United States telephone households. The survey was conducted by Princeton Survey Research International. Interviews were done in English by Princeton Data Source, LLC from May 4 to June 7, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"sub_headline":"","sub_title":"","_crdt_document":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","relatedPosts":[],"reportMaterials":[],"multiSectionReport":[],"package_parts__enabled":false,"package_parts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"bylines":[],"acknowledgements":[],"displayBylines":true,"footnotes":"","prc_watchers":[]},"categories":[],"tags":[],"bylines":[],"collection":[],"datasets":[],"level_of_effort":[],"primary_audience":[],"information_type":[],"_post_visibility":[],"formats":[458],"_fund_pool":[],"languages":[],"regions-countries":[],"research-teams":[526],"workflow-status":[],"class_list":["post-96659","post","type-post","status-publish","format-standard","hentry","formats-report","research-teams-internet"],"label":false,"post_parent":96783,"word_count":955,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/methodology-121-2\/","art_direction":false,"_embeds":[],"watchers":[],"table_of_contents":[{"id":96783,"title":"Digital Divisions","slug":"digital-divisions","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/digital-divisions\/","is_active":false},{"id":96796,"title":"Acknowledgements","slug":"acknowledgements-23","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/acknowledgements-23\/","is_active":false},{"id":96806,"title":"Part 1. Internet Access is the Norm, but is not Universal","slug":"part-1-internet-access-is-the-norm-but-is-not-universal","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/part-1-internet-access-is-the-norm-but-is-not-universal\/","is_active":false},{"id":96810,"title":"Part 2. Different Access Speeds","slug":"part-2-different-access-speeds","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/part-2-different-access-speeds\/","is_active":false},{"id":96659,"title":"Methodology","slug":"methodology-121-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/methodology-121-2\/","is_active":true}],"report_materials":"","report_pagination":{"current_post":{"id":96659,"title":"Methodology","slug":"methodology-121-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/methodology-121-2\/","is_active":true,"page_num":5},"next_post":null,"previous_post":{"id":96810,"title":"Part 2. Different Access Speeds","slug":"part-2-different-access-speeds","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/part-2-different-access-speeds\/","is_active":false,"page_num":4},"pagination_items":[{"id":96783,"title":"Digital Divisions","slug":"digital-divisions","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/digital-divisions\/","is_active":false,"page_num":1},{"id":96796,"title":"Acknowledgements","slug":"acknowledgements-23","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/acknowledgements-23\/","is_active":false,"page_num":2},{"id":96806,"title":"Part 1. Internet Access is the Norm, but is not Universal","slug":"part-1-internet-access-is-the-norm-but-is-not-universal","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/part-1-internet-access-is-the-norm-but-is-not-universal\/","is_active":false,"page_num":3},{"id":96810,"title":"Part 2. Different Access Speeds","slug":"part-2-different-access-speeds","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/part-2-different-access-speeds\/","is_active":false,"page_num":4},{"id":96659,"title":"Methodology","slug":"methodology-121-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2005\/10\/05\/methodology-121-2\/","is_active":true,"page_num":5}]},"parent_info":{"parent_title":"Digital Divisions","parent_id":96783},"materialsOrdered":[],"chaptersOrdered":[],"partsOrdered":[],"partsEnabled":false,"datacite_doi":"","prc_seo_data":{"title":"Methodology","description":"Summary This survey, sponsored by the Pew Internet &amp; American Life Project, obtained telephone interviews with a nationally representative sample of 2,001 adults living in continental United States telephone households.&hellip;","og_title":"Methodology","og_description":"","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"og_image":0,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{"prc-image-alt-text":{"status":"complete","message":"No image blocks in content.","data":null},"prc-about-this-research":{"status":"incomplete","message":"Add an \"About this research\" details block.","data":null},"prc-paragraph-count":{"status":"complete","message":"Found 13 paragraphs.","data":{"count":13}},"prc-internal-link":{"status":"incomplete","message":"Add at least one internal link.","data":{"count":0}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/96659","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=96659"}],"version-history":[{"count":2,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/96659\/revisions"}],"predecessor-version":[{"id":133778,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/96659\/revisions\/133778"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=96659"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=96659"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/tags?post=96659"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=96659"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=96659"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=96659"},{"taxonomy":"level_of_effort","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/level_of_effort?post=96659"},{"taxonomy":"primary_audience","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/primary_audience?post=96659"},{"taxonomy":"information_type","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/information_type?post=96659"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=96659"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=96659"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=96659"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=96659"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=96659"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=96659"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=96659"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}