{"id":94771,"date":"2013-02-28T00:00:00","date_gmt":"2013-02-28T05:00:00","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/2013\/02\/28\/methodology-3-7\/"},"modified":"2024-04-14T04:13:27","modified_gmt":"2024-04-14T09:13:27","slug":"methodology-3-7","status":"publish","type":"post","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/methodology-3-7\/","title":{"rendered":"Methodology"},"content":{"rendered":"<p class=\"wp-block-paragraph\">Data collection was conducted in two phases.\u00a0 In phase one, Pew Internet conducted<b> <\/b>two online and one in-person focus group with middle and high school teachers, as well as two in-person focus groups with students in grades 9-12. Focus group findings were instrumental in shaping the development of a 30-minute online survey, which was administered in phase two of the research to a national sample of middle and high school Advanced Placement and National Writing Project Summer Institute teachers, drawn from sample files provided by the College Board and the National Writing Project, respectively.<\/p>\n\n<p class=\"wp-block-paragraph\"> <strong>Phase One \u2014 Focus Groups<\/strong> <\/p>\n\n<p class=\"wp-block-paragraph\">Focus group discussions were designed to elicit from teachers and students their perceptions of the different ways digital technologies such as the internet, search engines, social media, and cell phones are impacting and shaping students\u2019 research and writing habits and skills.\u00a0 Teachers were also asked to speak in depth about their experiences teaching research and writing to middle and high school students today, any challenges they encounter, how they incorporate digital technologies into their classrooms and assignments, as well as how these technologies play a role in their professionalization.\u00a0 <\/p>\n\n<p class=\"wp-block-paragraph\">In-person focus groups were led by two Pew Internet researchers, and were held on-site at a College Board school in the northeastern United States, immediately following school hours.\u00a0\u00a0 Each discussion was approximately 1.5 hours in duration, and students and teachers were provided with Barnes &amp; Noble gift cards as a token of appreciation for their participation ($25 for students, $50 for teachers).\u00a0 Focus group discussions were recorded and transcribed.<\/p>\n\n<p class=\"wp-block-paragraph\">Two online focus groups were also held with teachers.\u00a0 The first utilized an existing online research community of 150 Advanced Placement teachers.\u00a0 A series of discussion questions or \u201cexercises\u201d designed by Pew Internet were administered to this group by panel administrators using an online, asynchronous platform.\u00a0 Panel administrators then provided Pew Internet with transcripts of responses to the exercises.\u00a0 <\/p>\n\n<p class=\"wp-block-paragraph\">The second online teacher focus group was administered by Pew Internet staff using an online focus group platform.\u00a0 Participants in this group consisted of 30 National Writing Project teachers recruited by NWP site administrators.\u00a0 The asynchronous 3-day focus group was moderated by Pew Internet staff, and all participants were able to see and respond to one another\u2019s comments as well as questions and comments from the moderators.\u00a0 Transcripts of the focus group were downloaded following completion of the discussion.\u00a0 <\/p>\n\n<p class=\"wp-block-paragraph\">All focus group sessions were analyzed to identify key themes, and discussion guides were revised and adjusted between groups to better probe emergent themes.\u00a0 All focus group discussion guides are available at the end of this section.<\/p>\n\n<p class=\"wp-block-paragraph\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"528\" height=\"445\" alt=\"Methodology 1\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/media\/4AF7056C3B3B41CDB0BE93C84F80647A.jpg\" class=\"aligncenter\"><\/figure>\n<\/p>\n\n<p class=\"wp-block-paragraph\"> <strong>Phase Two \u2013 Online Survey<\/strong> <\/p>\n\n<p class=\"wp-block-paragraph\">Following completion of focus group discussions, Pew Internet designed and fielded a 30-minute online survey with a national sample of middle and high school teachers.\u00a0 The sample is not a probability sample of all teachers because it was not practical to assemble a sampling frame of this population. Instead, two large lists of teachers were assembled: one included 42,879 AP teachers who had agreed to allow the College Board to contact them (about one-third of all AP teachers), while the other was a list of 5,869 teachers who participated in the National Writing Project\u2019s Summer Institute during 2007-2011. A stratified random sample of 16,721 AP teachers was drawn from the AP teacher list, based on subject taught, state, and grade level, while all members of the NWP list were included in the sample. <\/p>\n\n<p class=\"wp-block-paragraph\">Email invitations containing a link to the survey and unique username and password were sent to members of the sample; teachers could not opt-in to the sample. The response rate was 12% for the AP teachers and 14% for the NWP teachers. Given the nature of the sampling frames used for the study, no margin of error has been computed.\u00a0 <\/p>\n\n<p class=\"wp-block-paragraph\">The online survey was conducted from March 7\u2013April 23, 2012, and was completed at least in part by 2,462 teachers (2,067 teachers completed the entire survey; partial completes were kept, and all percentages reported are based on those answering each question).\u00a0 <\/p>\n\n<p class=\"wp-block-paragraph\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"530\" height=\"225\" alt=\"Methodology 2\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/media\/554ED37DC92F46568408F5D51515A990.jpg\" class=\"aligncenter\"><\/figure>\n<\/p>\n\n<p class=\"wp-block-paragraph\"> <strong>The teachers who participated in the survey <\/strong> <\/p>\n\n<p class=\"wp-block-paragraph\">The survey results presented here are <i>not<\/i> based on a representative sample of U.S. middle and high school teachers, yet every effort was made to administer the survey to as broad a sample of educators as possible from the samples available.\u00a0 Overall, the 2,462 Advanced Placement and NWP Summer Institute teachers who participated in the survey comprise a fairly wide range of subject areas, experience levels, geographic regions, school type and socioeconomic level, and community type (full sample characteristics below).\u00a0\u00a0\u00a0 <\/p>\n\n<p class=\"wp-block-paragraph\">The final sample includes teachers from all 50 states, Puerto Rico and the U.S. Virgin Islands.\u00a0 All teachers who participated in the survey teach in physical schools\/classrooms, as opposed to teaching online or virtual classes.\u00a0 English\/Language Arts teachers make up a significant portion of the sample (36%), reflecting the intentional design of the sample.\u00a0 Only 9% of the final sample is middle school teachers, with the other 91% reporting that they currently teach grades 9-12.\u00a0 While half of the teachers participating in the survey report teaching in a small city or suburb, there is fairly wide distribution across school size and students\u2019 socioeconomic status.\u00a0 There is also a wide distribution in terms of teachers\u2019 ages and experience levels.<\/p>\n\n<p class=\"wp-block-paragraph\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"499\" height=\"369\" alt=\"Methodology 3\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/media\/D553F34C6FC246BCB227DAC97187B3D4.jpg\" class=\"aligncenter\"><\/figure>\n<\/p>\n\n<p class=\"wp-block-paragraph\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"401\" height=\"642\" alt=\"Methodology 4\" src=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/wp-content\/uploads\/sites\/9\/media\/4CCC890E6AC1408B973011FB96D1EAFE.jpg\" class=\"aligncenter\"><\/figure>\n<\/p>\n\n<p class=\"wp-block-paragraph\"> <strong>Interpreting the results <\/strong> <\/p>\n\n<p class=\"wp-block-paragraph\">There are several important ways the teachers who participated in the survey are unique, which should be considered when interpreting the results reported here.\u00a0 First, 95% of the teachers who took the survey teach in public schools, thus the findings reported here reflect that environment almost exclusively.\u00a0 Moreover, and perhaps more importantly, the majority of teachers in this sample (56%) teach AP, honors and accelerated courses, thus the population of middle and high school students they work with skew heavily toward the highest achievers.\u00a0 These accelerated classes may have resources and support at their disposal\u2014particularly in terms of specialized training and access to digital tools\u2014that are not available in all classrooms.\u00a0 <\/p>\n\n<p class=\"wp-block-paragraph\">In addition, it is critical to keep in mind that almost a third of the sample (NWP teachers) has received extensive training in how to effectively teach writing in today\u2019s digital environment.\u00a0 The National Writing Project\u2019s mission is to provide professional development, resources and support to teachers to improve the teaching of writing in today\u2019s schools.\u00a0\u00a0 The NWP teachers included here are what the organization terms \u201cteacher-consultants\u201d who have attended the Summer Institute and provide local leadership to other teachers.\u00a0 Research has shown significant gains in the writing performance of students who are taught by these teachers.[10.numoffset=&#8221;10&#8243; More specific information on this population of teachers, the training they receive, and the outcomes of their students are available at the National Writing Project website at www.nwp.org.] <\/p>\n\n<p class=\"wp-block-paragraph\">Thus, the population of teachers participating in this research might best be considered \u201cleading edge teachers\u201d who are actively involved with the College Board and\/or the National Writing Project and are therefore beneficiaries of resources and training not common to all teachers.\u00a0 It is likely that teachers in this study are developing some of the more innovative pedagogical approaches to teaching research and writing in today\u2019s digital environment, and are incorporating classroom technology in ways that are not typical of the entire population of middle and high school teachers in the U.S.<\/p>\n\n<p class=\"wp-block-paragraph\"> <em>More information about this study&#8217;s survey questions and focus groups can be found at the <a href=\"~\/link.aspx?_id=C056B4BF97814F0594085CB84A30AC63&amp;_z=z\">beginning of this report<\/a>.<\/em> <\/p>","protected":false},"excerpt":{"rendered":"<p>Data collection was conducted in two phases.\u00a0 In phase one, Pew Internet conducted two online and one in-person focus group with middle and high school teachers, as well as two in-person focus groups with students in grades 9-12. Focus group findings were instrumental in shaping the development of a 30-minute online survey, which was administered [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"sub_headline":"","sub_title":"","_crdt_document":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","relatedPosts":[],"reportMaterials":[],"multiSectionReport":[],"package_parts__enabled":false,"package_parts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"bylines":[],"acknowledgements":[],"displayBylines":true,"footnotes":"","prc_watchers":[]},"categories":[],"tags":[],"bylines":[],"collection":[],"datasets":[],"level_of_effort":[],"primary_audience":[],"information_type":[],"_post_visibility":[],"formats":[458],"_fund_pool":[],"languages":[],"regions-countries":[],"research-teams":[526],"workflow-status":[],"class_list":["post-94771","post","type-post","status-publish","format-standard","hentry","formats-report","research-teams-internet"],"label":false,"post_parent":94764,"word_count":1221,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/methodology-3-7\/","art_direction":false,"_embeds":[],"watchers":[],"table_of_contents":[{"id":94764,"title":"How Teachers Are Using Technology at Home and in Their Classrooms","slug":"how-teachers-are-using-technology-at-home-and-in-their-classrooms","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/how-teachers-are-using-technology-at-home-and-in-their-classrooms\/","is_active":false},{"id":94756,"title":"Part I: Introduction","slug":"part-i-introduction-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/part-i-introduction-2\/","is_active":false},{"id":94723,"title":"Part II: Teachers\u2019 Own Use of the Internet and Mobile Tools","slug":"part-ii-teachers-own-use-of-the-internet-and-mobile-tools","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/part-ii-teachers-own-use-of-the-internet-and-mobile-tools\/","is_active":false},{"id":94717,"title":"Part III: Bringing Technology into the Classroom","slug":"part-iii-bringing-technology-into-the-classroom","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/part-iii-bringing-technology-into-the-classroom\/","is_active":false},{"id":94710,"title":"Part IV: The Impact of the Internet and Digital Tools on Teachers\u2019 Professional Development","slug":"part-iv-the-impact-of-the-internet-and-digital-tools-on-teachers-professional-development","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/part-iv-the-impact-of-the-internet-and-digital-tools-on-teachers-professional-development\/","is_active":false},{"id":94771,"title":"Methodology","slug":"methodology-3-7","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/methodology-3-7\/","is_active":true}],"report_materials":"","report_pagination":{"current_post":{"id":94771,"title":"Methodology","slug":"methodology-3-7","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/methodology-3-7\/","is_active":true,"page_num":6},"next_post":null,"previous_post":{"id":94710,"title":"Part IV: The Impact of the Internet and Digital Tools on Teachers\u2019 Professional Development","slug":"part-iv-the-impact-of-the-internet-and-digital-tools-on-teachers-professional-development","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/part-iv-the-impact-of-the-internet-and-digital-tools-on-teachers-professional-development\/","is_active":false,"page_num":5},"pagination_items":[{"id":94764,"title":"How Teachers Are Using Technology at Home and in Their Classrooms","slug":"how-teachers-are-using-technology-at-home-and-in-their-classrooms","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/how-teachers-are-using-technology-at-home-and-in-their-classrooms\/","is_active":false,"page_num":1},{"id":94756,"title":"Part I: Introduction","slug":"part-i-introduction-2","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/part-i-introduction-2\/","is_active":false,"page_num":2},{"id":94723,"title":"Part II: Teachers\u2019 Own Use of the Internet and Mobile Tools","slug":"part-ii-teachers-own-use-of-the-internet-and-mobile-tools","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/part-ii-teachers-own-use-of-the-internet-and-mobile-tools\/","is_active":false,"page_num":3},{"id":94717,"title":"Part III: Bringing Technology into the Classroom","slug":"part-iii-bringing-technology-into-the-classroom","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/part-iii-bringing-technology-into-the-classroom\/","is_active":false,"page_num":4},{"id":94710,"title":"Part IV: The Impact of the Internet and Digital Tools on Teachers\u2019 Professional Development","slug":"part-iv-the-impact-of-the-internet-and-digital-tools-on-teachers-professional-development","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/part-iv-the-impact-of-the-internet-and-digital-tools-on-teachers-professional-development\/","is_active":false,"page_num":5},{"id":94771,"title":"Methodology","slug":"methodology-3-7","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/internet\/2013\/02\/28\/methodology-3-7\/","is_active":true,"page_num":6}]},"parent_info":{"parent_title":"How Teachers Are Using Technology at Home and in Their Classrooms","parent_id":94764},"materialsOrdered":[],"chaptersOrdered":[],"partsOrdered":[],"partsEnabled":false,"datacite_doi":"","prc_seo_data":{"title":"Methodology","description":"Data collection was conducted in two phases.\u00a0 In phase one, Pew Internet conducted two online and one in-person focus group with middle and high school teachers, as well as two&hellip;","og_title":"Methodology","og_description":"","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"og_image":0,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{"prc-image-alt-text":{"status":"complete","message":"No image blocks in content.","data":null},"prc-about-this-research":{"status":"incomplete","message":"Add an \"About this research\" details block.","data":null},"prc-paragraph-count":{"status":"complete","message":"Found 19 paragraphs.","data":{"count":19}},"prc-internal-link":{"status":"complete","message":"Found 1 internal link.","data":{"count":1}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/94771","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=94771"}],"version-history":[{"count":2,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/94771\/revisions"}],"predecessor-version":[{"id":132313,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/94771\/revisions\/132313"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=94771"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=94771"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/tags?post=94771"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=94771"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=94771"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=94771"},{"taxonomy":"level_of_effort","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/level_of_effort?post=94771"},{"taxonomy":"primary_audience","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/primary_audience?post=94771"},{"taxonomy":"information_type","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/information_type?post=94771"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=94771"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=94771"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=94771"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=94771"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=94771"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=94771"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=94771"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}