{"id":88557,"date":"2015-07-03T11:47:40","date_gmt":"2015-07-03T16:47:40","guid":{"rendered":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/2015\/07\/03\/methodology-as-greeks-head-to-the-polls-the-twitter-conversation-differs-by-language\/"},"modified":"2024-04-14T04:15:23","modified_gmt":"2024-04-14T09:15:23","slug":"methodology-as-greeks-head-to-the-polls-the-twitter-conversation-differs-by-language","status":"publish","type":"post","link":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2015\/07\/03\/methodology-as-greeks-head-to-the-polls-the-twitter-conversation-differs-by-language\/","title":{"rendered":"Methodology: As Greeks head to the polls, the Twitter conversation differs by language"},"content":{"rendered":"<p class=\"wp-block-paragraph\">This analysis of the Twitter discussions surrounding the 2015 Greek referendum employed media research methods that combined Pew Research\u2019s content analysis rules with computer coding software developed by\u00a0<a href=\"http:\/\/www.crimsonhexagon.com\/\">Crimson Hexagon<\/a>\u00a0(CH). This report is based on examination of about 2.5 million Twitter statements that were identified as being about the Greek developments in light of the July 5th referendum. An additional analysis of about 300,000 tweets was conducted examining the sentiment toward Greek prime minister Alexis Tsipras, following the referendum. The primary searches were conducted in English and Greek. The data were gathered and analyzed by Michael Barthel and Katerina Eva Matsa.<\/p>\n\n<p class=\"wp-block-paragraph\">Crimson Hexagon is a software platform that identifies statistical patterns in words used in online texts. Researchers enter key terms using Boolean search logic so the software can identify relevant material to analyze. Pew Research draws its analysis sample from all public Twitter posts. Then a researcher trains the software to classify documents using examples from those collected posts. Finally, the software classifies the rest of the online content according to the patterns derived during the training. While automated sentiment analysis is not perfect, the Center has conducted numerous tests and determined that Crimson Hexagon\u2019s method of analysis is among the most accurate tools available. Multiple tests suggest that human coders and Crimson Hexagon\u2019s results are in agreement between 75% and 83% of the time. (For a more in-depth explanation on how Crimson Hexagon\u2019s technology works click\u00a0<a href=\"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2015\/04\/01\/methodology-crimson-hexagon\/\">here<\/a>.)<\/p>\n\n<p class=\"wp-block-paragraph\">Greek is considered an &#8220;unsupported language&#8221; in Buzz monitors, which are not being used in this analysis. Opinion monitors, which we are using, are trained by a\u00a0researcher fluent in the language.<\/p>\n\n<p class=\"wp-block-paragraph\">This study contains an analysis of the sentiment or tone of the conversation on Twitter.<\/p>\n\n<p class=\"wp-block-paragraph\">All tweets analyzed in this report were collected between 12 am EDT, June 26, 2015 to 11:59 pm EDT, July 1, 2015 and between July 6,\u00a02015 to 11:59 pm EDT, July 12, 2015.<\/p>\n\n<p class=\"wp-block-paragraph\">Each Boolean search used keywords in English and Greek only.<\/p>\n\n<p class=\"wp-block-paragraph\">The Boolean searches used for each monitor included a variety of terms relevant to the subject being examined.<\/p>\n\n<p class=\"wp-block-paragraph\">For example, the search used to identify tweets in English about the recent developments in Greece was: (Crisis AND Greece) OR (Greece AND EU) OR (Greece AND European) OR (Greek AND crisis) OR (Greek AND European) OR (Greek AND EU) OR (Greek AND IMF) OR (Greece AND IMF) OR Greece OR debt OR bankruptcy OR default OR bankrupted OR referendum OR grexit OR greferendum OR Eurogroup OR Tsipras OR Syriza OR (Greece AND Europe) OR (Greek AND Europe) OR yeseurope OR oxi<\/p>\n\n<p class=\"wp-block-paragraph\">And the search used to identify tweets in Greek about the recent developments in Greece was: \u039a\u03c1\u03af\u03c3\u03b7 OR \u03ba\u03c1\u03b9\u03c3\u03b7 OR \u0395\u03c5\u03c1\u03ce\u03c0\u03b7 OR \u0395\u03c5\u03c1\u03c9\u03c0\u03b7 OR \u0395\u0395 OR &#8220;\u0395\u03c5\u03c1\u03c9\u03c0\u03b1\u03ca\u03ba\u03ae \u0388\u03bd\u03c9\u03c3\u03b7&#8221; OR &#8220;\u0395\u03c5\u03c1\u03c9\u03c0\u03b1\u03b9\u03ba\u03b7 \u0395\u03bd\u03c9\u03c3\u03b7&#8221; OR \u0395\u03bb\u03bb\u03ac\u03b4\u03b1 OR \u03b4\u03b7\u03bc\u03bf\u03c8\u03ae\u03c6\u03b9\u03c3\u03bc\u03b1 OR \u03b4\u03b7\u03bc\u03bf\u03c8\u03b7\u03c6\u03b9\u03c3\u03bc\u03b1 OR \u03ba\u03c1\u03af\u03c3\u03b7 OR \u03ba\u03c1\u03b9\u03c3\u03b7 OR \u03c7\u03c1\u03ad\u03bf\u03c2 OR \u03c7\u03c1\u03b5\u03bf\u03c2 OR \u03a3\u03cd\u03c1\u03b9\u03b6\u03b1 OR \u03a3\u03c5\u03c1\u03b9\u03b6\u03b1 OR \u03ba\u03c5\u03b2\u03ad\u03c1\u03bd\u03b7\u03c3\u03b7 OR \u03ba\u03c5\u03b2\u03b5\u03c1\u03bd\u03b7\u03c3\u03b7 OR \u03b1\u03bd\u03c4\u03b9\u03c0\u03bf\u03bb\u03af\u03c4\u03b5\u03c5\u03c3\u03b7 OR \u03b1\u03bd\u03c4\u03b9\u03c0\u03bf\u03bb\u03b9\u03c4\u03b5\u03c5\u03c3\u03b7 OR \u03a4\u03c3\u03af\u03c0\u03c1\u03b1\u03c2 OR \u03a4\u03c3\u03b9\u03c0\u03c1\u03b1\u03c2 OR \u03b8\u03b5\u03c3\u03bc\u03bf\u03af OR \u03b8\u03b5\u03c3\u03bc\u03ce\u03bd OR \u03b8\u03b5\u03c3\u03bc\u03bf\u03b9 OR \u03b8\u03b5\u03c3\u03bc\u03c9\u03bd OR \u03a4\u03c1\u03cc\u03ca\u03ba\u03b1 OR \u03a4\u03c1\u03bf\u03b9\u03ba\u03b1<\/p>\n\n<p class=\"wp-block-paragraph\">All tweets were put into one of four categories: positive, neutral, negative or off topic. Depending on the search, a tweet was considered positive if it clearly supported the Yes in relation to the referendum, and considered negative if it clearly supported No.<\/p>\n\n<p class=\"wp-block-paragraph\">References to debt or the default were only included in the study if the tweet was clearly focused on Greece. The algorithm was trained to consider references to other debts or defaults, such as in Puerto Rico, as off-topic, and were excluded from the study.<\/p>\n\n<p class=\"wp-block-paragraph\">CH monitors examine the entire Twitter discussion in the aggregate. To do that, the algorithm breaks up all relevant texts into subsections. Rather than the dividing each story, paragraph, sentence or word, CH treats the \u201cassertion\u201d as the unit of measurement. Thus, posts are divided up by the computer algorithm. Consequently, the results are not expressed in percent of newshole or percent of stories. Instead, the results are the percent of assertions out of the entire body of stories identified by the original Boolean search terms. We refer to the entire collection of assertions as the \u201cconversation.\u201d<\/p>","protected":false},"excerpt":{"rendered":"<p>This analysis of the Twitter discussions surrounding the 2015 Greek referendum employed media research methods that combined Pew Research\u2019s content analysis rules with computer coding software developed by\u00a0Crimson Hexagon\u00a0(CH). This report is based on examination of about 2.5 million Twitter statements that were identified as being about the Greek developments in light of the July [&hellip;]<\/p>\n","protected":false},"author":43,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"sub_headline":"","sub_title":"","_prc_public_revisions":[],"_ppp_expiration_hours":0,"_ppp_enabled":false,"ai_generated_summary":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"relatedPosts":[],"reportMaterials":[],"multiSectionReport":[],"package_parts__enabled":false,"package_parts":[],"_prc_fork_parent":0,"_prc_fork_status":"","_prc_active_fork":0,"datacite_doi":"","datacite_doi_citation":"","_prc_seo_qr_attachment_id":0,"spoken_article_player_enabled":true,"displayBylines":true,"footnotes":"","prc_watchers":[],"jetpack_post_was_ever_published":false},"categories":[],"tags":[],"bylines":[983],"collection":[],"datasets":[],"level_of_effort":[],"primary_audience":[],"information_type":[],"_post_visibility":[],"formats":[458],"_fund_pool":[],"languages":[],"regions-countries":[],"research-teams":[527],"workflow-status":[],"class_list":["post-88557","post","type-post","status-publish","format-standard","hentry","bylines-katerina-eva-matsa","formats-report","research-teams-journalism"],"label":false,"post_parent":0,"word_count":647,"canonical_url":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/journalism\/2015\/07\/03\/methodology-as-greeks-head-to-the-polls-the-twitter-conversation-differs-by-language\/","art_direction":false,"_embeds":[],"watchers":[],"table_of_contents":[],"report_materials":"","report_pagination":{"current_post":null,"next_post":null,"previous_post":null,"pagination_items":[]},"parent_info":{"parent_title":"Methodology: As Greeks head to the polls, the Twitter conversation differs by language","parent_id":88557},"materialsOrdered":[],"chaptersOrdered":[],"partsOrdered":[],"partsEnabled":false,"datacite_doi":"","prc_seo_data":{"title":"Methodology: As Greeks head to the polls, the Twitter conversation differs by language","description":"This analysis of the Twitter discussions surrounding the 2015 Greek referendum employed media research methods that combined Pew Research\u2019s content analysis rules with computer coding software developed by\u00a0Crimson Hexagon\u00a0(CH). This&hellip;","og_title":"Methodology: As Greeks head to the polls, the Twitter conversation differs by language","og_description":"","schema_type":"Article","noindex":false,"canonical_url":"","primary_terms":[],"custom_schema":[],"og_image":0,"indexnow_submitted_at":null,"gsc_index_status":null},"prepublish_checks":{"prc-image-alt-text":{"status":"complete","message":"No image blocks in content.","data":null},"prc-about-this-research":{"status":"incomplete","message":"Add an \"About this research\" details block.","data":null},"prc-paragraph-count":{"status":"complete","message":"Found 12 paragraphs.","data":{"count":12}},"prc-internal-link":{"status":"complete","message":"Found 1 internal link.","data":{"count":1}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"relatedPostsOrdered":[],"bylinesOrdered":[{"key":"d2f07805-1373-479b-a294-4b215d7906ff","termId":983}],"acknowledgementsOrdered":[],"_links":{"self":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/88557","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/users\/43"}],"replies":[{"embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/comments?post=88557"}],"version-history":[{"count":1,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/88557\/revisions"}],"predecessor-version":[{"id":135087,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/posts\/88557\/revisions\/135087"}],"wp:attachment":[{"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/media?parent=88557"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/categories?post=88557"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/tags?post=88557"},{"taxonomy":"bylines","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/bylines?post=88557"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/collection?post=88557"},{"taxonomy":"datasets","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/datasets?post=88557"},{"taxonomy":"level_of_effort","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/level_of_effort?post=88557"},{"taxonomy":"primary_audience","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/primary_audience?post=88557"},{"taxonomy":"information_type","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/information_type?post=88557"},{"taxonomy":"_post_visibility","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_post_visibility?post=88557"},{"taxonomy":"formats","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/formats?post=88557"},{"taxonomy":"_fund_pool","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/_fund_pool?post=88557"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/languages?post=88557"},{"taxonomy":"regions-countries","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/regions-countries?post=88557"},{"taxonomy":"research-teams","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/research-teams?post=88557"},{"taxonomy":"workflow-status","embeddable":true,"href":"https:\/\/alpha.pewresearch.org\/pewresearch-org\/wp-json\/wp\/v2\/workflow-status?post=88557"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}