{"id":92740,"date":"2022-11-16T09:57:15","date_gmt":"2022-11-16T14:57:15","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/2022\/11\/16\/appendix-a-survey-methodology-11\/"},"modified":"2025-01-23T09:44:24","modified_gmt":"2025-01-23T14:44:24","slug":"appendix-a-survey-methodology-11","status":"publish","type":"post","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-a-survey-methodology-11\/","title":{"rendered":"Appendix A: Survey methodology"},"content":{"rendered":"\n

The analysis in this report is based on a self-administered web survey conducted from April 14 to May 4, 2022, among a sample of 1,316 dyads, with each dyad (or pair) comprised of one U.S. teen age 13 to 17 and one parent per teen. The margin of sampling error for the full sample of 1,316 teens is plus or minus 3.2 percentage points. The survey was conducted by Ipsos Public Affairs in English and Spanish using KnowledgePanel, its nationally representative online research panel.<\/p>\n\n\n\n

The research plan for this project was submitted to an external institutional review board (IRB), Advarra, which is an independent committee of experts that specializes in helping to protect the rights of research participants. The IRB thoroughly vetted this research before recruitment for the focus groups began. Due to the risks associated with surveying minors, this research underwent a full board review and received approval (Pro00060166).<\/p>\n\n\n\n

KnowledgePanel members are recruited through probability sampling methods and include both those with internet access and those who did not have internet access at the time of their recruitment. KnowledgePanel provides internet access for those who do not have it and, if needed, a device to access the internet when they join the panel. KnowledgePanel\u2019s recruitment process was originally based exclusively on a national random-digit-dialing (RDD) sampling methodology. In 2009, Ipsos migrated to an address-based sampling (ABS) recruitment methodology via the U.S. Postal Service\u2019s Delivery Sequence File. The Delivery Sequence File has been estimated to cover as much as 98% of the population, although some studies suggest that the coverage could be in the low 90% range.[7.numoffset=”7″ AAPOR Task force on Address-based Sampling. 2016. \u201cAAPOR Report: Address-based Sampling.\u201d<\/a>]<\/p>\n\n\n\n

Panelists were eligible for participation in this survey if they indicated on an earlier profile survey that they were the parent of a teen age 13 to 17. A random sample of 5,580 eligible panel members were invited to participate in the study. Responding parents were screened and considered qualified for the study if they reconfirmed that they were the parent of at least one child age 13 to 17 and granted permission for their teen who was chosen to participate in the study. In households with more than one eligible teen, parents were asked to think about one randomly selected teen; that teen was instructed to complete the teen portion of the survey. A survey was considered complete if both the parent and selected teen completed their portions of the questionnaire, or if the parent did not qualify during the initial screening.<\/p>\n\n\n\n

Of the sampled panelists, 1,607 (excluding break-offs) responded to the invitation and 1,316 qualified, completed the parent portion of the survey, and had their selected teen complete the teen portion of the survey, yielding a final stage completion rate of 29% and a qualification rate of 82%.[8. The 1,316 qualified and completed interviews exclude seven cases that were dropped because respondents did not answer one-third or more of the survey questions.] The cumulative response rate accounting for nonresponse to the recruitment surveys and attrition is 1%. The break-off rate among those who logged on to the survey (regardless of whether they completed any items or qualified for the study) is 37%.<\/p>\n\n\n\n

Upon completion, qualified respondents received a cash-equivalent incentive worth $10 for completing the survey.<\/p>\n\n\n\n

Panelists were assigned to take the survey in batches. Email invitations and reminders were sent to panelists according to a schedule based on when they were assigned this survey in their personalized member portal, shown in the table below. The field period was closed on May 4, 2022, and thus no further email contacts past the invitation were sent for the final set of panelists.<\/p>\n\n\n\n

\"Invitation<\/a><\/figure>\n\n\n\n

Weighting<\/h4>\n\n\n\n
\"Weighting<\/a><\/figure>\n\n\n\n

The analysis in this report was performed using a teen weight. A weight for parents was also constructed, forming the basis of the teen weight. The parent weight was created in a multistep process that begins with a base design weight for the parent, which is computed to reflect their probability of selection for recruitment into the KnowledgePanel. These selection probabilities were then adjusted to account for the probability of selection for this survey, which included oversamples of Black and Hispanic parents. Next, an iterative technique was used to align the parent design weights to population benchmarks for parents of teens ages 13 to 17 on the dimensions identified in the accompanying table, to account for any differential nonresponse that may have occurred.<\/p>\n\n\n\n

To create the teen weight, an adjustment factor was applied to the final parent weight to reflect the selection of one teen per household. Finally, the teen weights were further raked to match the demographic distribution for teens ages 13 to 17 who live with parents. The teen weights were adjusted on the same teen dimensions as parent dimensions with the exception of teen education, which was not used in the teen weighting.<\/p>\n\n\n\n

Sampling errors and tests of statistical significance take into account the effect of weighting. Interviews were conducted in both English and Spanish.<\/p>\n\n\n\n

In addition to sampling error, one should bear in mind that question wording and practical difficulties in conducting surveys can introduce error or bias into the findings of opinion polls.<\/p>\n\n\n\n

The following tables show the unweighted sample sizes and the error attributable to sampling that would be expected at the 95% level of confidence for different groups in the survey:<\/p>\n\n\n\n

\"The<\/a><\/figure>\n\n\n\n

Sample sizes and sampling errors for other subgroups are available upon request.<\/p>\n\n\n\n

Dispositions and response rates<\/h4>\n\n\n\n

The tables below display dispositions used in the calculation of completion, qualification and cumulative response rates.[9. For more information on this method of calculating response rates, see Callegaro, Mario & DiSogra, Charles. 2008. \u201cComputing response metrics for online panels<\/a>.\u201d Public Opinion Quarterly.]<\/p>\n\n\n\n

\"Dispositions\"<\/a><\/figure>\n\n\n\n
\"Cumulative<\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"

The analysis in this report is based on a self-administered web survey conducted from April 14 to May 4, 2022, among a sample of 1,316 dyads, with each dyad (or pair) comprised of one U.S. teen age 13 to 17 and one parent per teen. The margin of sampling error for the full sample of […]<\/p>\n","protected":false},"author":377,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"sub_headline":"","sub_title":"","_crdt_document":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","relatedPosts":[],"reportMaterials":[],"multiSectionReport":[],"package_parts__enabled":false,"package_parts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"bylines":[],"acknowledgements":[],"displayBylines":true,"footnotes":"","prc_watchers":[]},"categories":[276,307,288,290,206],"tags":[],"bylines":[971,696,913,940],"collection":[],"datasets":[],"level_of_effort":[],"primary_audience":[],"information_type":[],"_post_visibility":[],"formats":[458],"_fund_pool":[],"languages":[],"regions-countries":[],"research-teams":[526],"workflow-status":[],"class_list":["post-92740","post","type-post","status-publish","format-standard","hentry","category-lifestyle-relationships-online","category-social-media","category-stresses-distraction-online","category-teens-tech","category-teens-youth","bylines-andrew-perrin","bylines-emily-a-vogels","bylines-lee-rainie","bylines-monica-anderson","formats-report","research-teams-internet"],"label":false,"post_parent":92736,"word_count":920,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-a-survey-methodology-11\/","art_direction":{"A1":{"id":114559,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png?w=564&h=317&crop=1","width":564,"height":317,"caption":"(FatCamera\/Getty Images)","chartArt":false},"A2":{"id":114559,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png?w=268&h=151&crop=1","width":268,"height":151,"caption":"(FatCamera\/Getty Images)","chartArt":false},"A3":{"id":114559,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png?w=194&h=110&crop=1","width":194,"height":110,"caption":"(FatCamera\/Getty Images)","chartArt":false},"A4":{"id":114559,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png?w=268&h=151&crop=1","width":268,"height":151,"caption":"(FatCamera\/Getty Images)","chartArt":false},"XL":{"id":114559,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png?w=720&h=405&crop=1","width":720,"height":405,"caption":"(FatCamera\/Getty Images)","chartArt":false},"social":{"id":114559,"rawUrl":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png","url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_22.11.13_TeensSocialMedia_featured.png?w=1200&h=628&crop=1","width":1200,"height":628,"caption":"(FatCamera\/Getty Images)","chartArt":false}},"_embeds":[],"watchers":[],"table_of_contents":[{"id":92736,"title":"Connection, Creativity and Drama: Teen Life on Social Media in 2022","slug":"connection-creativity-and-drama-teen-life-on-social-media-in-2022","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/connection-creativity-and-drama-teen-life-on-social-media-in-2022\/","is_active":false},{"id":92751,"title":"1. What teens post on social media","slug":"1-what-teens-post-on-social-media","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/1-what-teens-post-on-social-media\/","is_active":false},{"id":92724,"title":"2. Teens\u2019 views about social media","slug":"2-teens-views-about-social-media","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/2-teens-views-about-social-media\/","is_active":false},{"id":92746,"title":"3. Focus groups: Social media stirs a range of emotions and reactions in teens","slug":"focus-groups-social-media-stirs-a-range-of-emotions-and-reactions-in-teens","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/focus-groups-social-media-stirs-a-range-of-emotions-and-reactions-in-teens\/","is_active":false},{"id":92738,"title":"Acknowledgments","slug":"acknowledgments-42-3","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/acknowledgments-42-3\/","is_active":false},{"id":92740,"title":"Appendix A: Survey methodology","slug":"appendix-a-survey-methodology-11","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-a-survey-methodology-11\/","is_active":true},{"id":92755,"title":"Appendix B: Focus groups methodology","slug":"appendix-b-focus-groups-methodology-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-b-focus-groups-methodology-2\/","is_active":false},{"id":92731,"title":"Appendix C: Supplementary table","slug":"appendix-c-supplementary-table","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-c-supplementary-table\/","is_active":false}],"report_materials":[{"key":"_mysgemm29","type":"report","attachmentId":114556,"url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_2022.11.16_Teens-Social-Media-Connection_FINAL.pdf","label":"","icon":""},{"key":"_2z2fm1df8","type":"topline","attachmentId":114554,"url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-content\/uploads\/sites\/20\/2022\/11\/PI_2022.11.16_Teens-Social-Media-Connection_TOPLINE.pdf","label":"","icon":""}],"report_pagination":{"current_post":{"id":92740,"title":"Appendix A: Survey methodology","slug":"appendix-a-survey-methodology-11","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-a-survey-methodology-11\/","is_active":true,"page_num":6},"next_post":{"id":92755,"title":"Appendix B: Focus groups methodology","slug":"appendix-b-focus-groups-methodology-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-b-focus-groups-methodology-2\/","is_active":false,"page_num":7},"previous_post":{"id":92738,"title":"Acknowledgments","slug":"acknowledgments-42-3","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/acknowledgments-42-3\/","is_active":false,"page_num":5},"pagination_items":[{"id":92736,"title":"Connection, Creativity and Drama: Teen Life on Social Media in 2022","slug":"connection-creativity-and-drama-teen-life-on-social-media-in-2022","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/connection-creativity-and-drama-teen-life-on-social-media-in-2022\/","is_active":false,"page_num":1},{"id":92751,"title":"1. What teens post on social media","slug":"1-what-teens-post-on-social-media","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/1-what-teens-post-on-social-media\/","is_active":false,"page_num":2},{"id":92724,"title":"2. Teens\u2019 views about social media","slug":"2-teens-views-about-social-media","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/2-teens-views-about-social-media\/","is_active":false,"page_num":3},{"id":92746,"title":"3. Focus groups: Social media stirs a range of emotions and reactions in teens","slug":"focus-groups-social-media-stirs-a-range-of-emotions-and-reactions-in-teens","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/focus-groups-social-media-stirs-a-range-of-emotions-and-reactions-in-teens\/","is_active":false,"page_num":4},{"id":92738,"title":"Acknowledgments","slug":"acknowledgments-42-3","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/acknowledgments-42-3\/","is_active":false,"page_num":5},{"id":92740,"title":"Appendix A: Survey methodology","slug":"appendix-a-survey-methodology-11","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-a-survey-methodology-11\/","is_active":true,"page_num":6},{"id":92755,"title":"Appendix B: Focus groups methodology","slug":"appendix-b-focus-groups-methodology-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-b-focus-groups-methodology-2\/","is_active":false,"page_num":7},{"id":92731,"title":"Appendix C: Supplementary table","slug":"appendix-c-supplementary-table","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2022\/11\/16\/appendix-c-supplementary-table\/","is_active":false,"page_num":8}]},"parent_info":{"parent_title":"Connection, Creativity and Drama: Teen Life on Social Media in 2022","parent_id":92736},"materialsOrdered":[],"chaptersOrdered":[],"partsOrdered":[],"partsEnabled":false,"datacite_doi":"","prc_seo_data":{"title":"Appendix A: Survey methodology","description":"The analysis in this report is based on a self-administered web survey conducted from April 14 to May 4, 2022, among a sample of 1,316 dyads, with each dyad (or…","og_title":"Appendix A: Survey methodology","og_description":"","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":{"research-teams":10814757},"custom_schema":[],"og_image":114559,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{"prc-image-alt-text":{"status":"complete","message":"All images have alt text.","data":null},"prc-about-this-research":{"status":"incomplete","message":"Add an \"About this research\" details block.","data":null},"prc-paragraph-count":{"status":"complete","message":"Found 14 paragraphs.","data":{"count":14}},"prc-internal-link":{"status":"complete","message":"Found 5 internal links.","data":{"count":5}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/92740","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/377"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=92740"}],"version-history":[{"count":2,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/92740\/revisions"}],"predecessor-version":[{"id":127846,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/92740\/revisions\/127846"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=92740"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=92740"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/tags?post=92740"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=92740"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=92740"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=92740"},{"taxonomy":"level_of_effort","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/level_of_effort?post=92740"},{"taxonomy":"primary_audience","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/primary_audience?post=92740"},{"taxonomy":"information_type","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/information_type?post=92740"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=92740"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=92740"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=92740"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=92740"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=92740"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=92740"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=92740"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}